[ 549.710635] env[66763]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 549.710635] env[66763]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 550.714556] env[66854]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 550.714556] env[66854]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 552.539515] env[66854]: INFO neutron.common.config [-] Logging enabled! [ 552.539876] env[66854]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev31 [ 552.540032] env[66854]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66854) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 552.540323] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 552.540421] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 552.541222] env[66854]: WARNING oslo_policy.policy [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 552.541433] env[66854]: WARNING oslo_policy.policy [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 552.543051] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] VMware NSXv3 Agent initialized successfully. [ 552.543403] env[66854]: DEBUG oslo_concurrency.lockutils [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] Acquiring lock "singleton_lock" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.543532] env[66854]: DEBUG oslo_concurrency.lockutils [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] Acquired lock "singleton_lock" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.543730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] Releasing lock "singleton_lock" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.544025] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] Full set of CONF: {{(pid=66854) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 552.544139] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ******************************************************************************** {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 552.544241] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] Configuration options gathered from: {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 552.544806] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 552.544976] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 552.545100] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ================================================================================ {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 552.545265] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] agent_down_time = 75 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.545404] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] allow_automatic_dhcp_failover = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.545536] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] allow_bulk = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.545674] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] api_extensions_path = {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.545809] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] api_paste_config = api-paste.ini {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.545944] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] auth_strategy = keystone {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.546058] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] backdoor_port = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.546161] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] backdoor_socket = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.546291] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] backlog = 4096 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.546422] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] base_mac = fa:16:3e:00:00:00 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.546573] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] bind_host = 0.0.0.0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.546709] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] bind_port = 9696 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.546838] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] client_socket_timeout = 900 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.546969] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] config_dir = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.547109] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.547254] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] config_source = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.547393] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] control_exchange = neutron {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.547528] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] core_plugin = ml2 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.547661] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] debug = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.547794] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] default_availability_zones = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.547994] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.548174] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] dhcp_agent_notification = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.548313] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] dhcp_agents_per_network = 1 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.548443] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] dhcp_lease_duration = 86400 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.548580] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] dhcp_load_type = networks {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.548711] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] dns_domain = openstacklocal {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.548842] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.548968] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] enable_default_route_bfd = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.549107] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] enable_default_route_ecmp = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.549236] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] enable_dvr = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.549359] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] enable_new_agents = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.549480] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.549605] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] enable_signals = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.549728] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] enable_traditional_dhcp = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.549853] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] external_dns_driver = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.549981] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] filter_validation = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.550130] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] global_physnet_mtu = 8950 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.550265] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] graceful_shutdown_timeout = 60 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.550433] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] host = cpu-1 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.550569] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] host_dvr_for_dhcp = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.550712] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] http_retries = 3 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.550850] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] instance_format = [instance: %(uuid)s] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.550984] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.551133] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ipam_driver = internal {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.551264] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ipv6_pd_enabled = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.551432] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] l3_ha = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.551604] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.551745] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] l3_ha_network_physical_name = {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.551878] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] l3_ha_network_type = {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.552018] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] log_color = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.552155] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] log_config_append = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.552292] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.552418] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] log_dir = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.552544] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] log_file = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.552643] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] log_options = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.552774] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] log_rotate_interval = 1 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.552911] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] log_rotate_interval_type = days {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.553058] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] log_rotation_type = none {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.553165] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.553264] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.553400] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.553533] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.553634] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.553766] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] max_dns_nameservers = 5 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.553894] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] max_header_line = 16384 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.554030] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] max_l3_agents_per_router = 3 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.554161] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] max_logfile_count = 30 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.554289] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] max_logfile_size_mb = 200 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.554414] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] max_subnet_host_routes = 20 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.554546] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] my_ip = 10.180.1.21 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.554678] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] my_ipv6 = ::1 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.554804] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] network_auto_schedule = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.554928] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] network_link_prefix = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.555097] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.555263] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] notify_nova_on_port_data_changes = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.555399] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] notify_nova_on_port_status_changes = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.555534] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] pagination_max_limit = -1 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.555661] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] publish_errors = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.555788] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] rate_limit_burst = 0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.555921] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] rate_limit_except_level = CRITICAL {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.556057] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] rate_limit_interval = 0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.556193] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] retry_until_window = 30 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.556320] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] router_distributed = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.556447] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] rpc_resources_processing_step = 20 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.556573] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] rpc_response_max_timeout = 600 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.556701] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] rpc_response_timeout = 60 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.556829] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] send_events_interval = 2 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.556972] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] service_plugins = ['router'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.557149] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] setproctitle = on {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.557280] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] shell_completion = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.557414] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] state_path = /opt/stack/data/neutron {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.557546] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] syslog_log_facility = LOG_USER {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.557676] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] tcp_keepidle = 600 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.557808] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] transport_url = **** {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.557935] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] use_journal = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.558093] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] use_json = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.558239] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] use_ssl = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.558364] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] use_stderr = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.558495] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] use_syslog = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.558618] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] vlan_qinq = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.558740] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] vlan_transparent = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.558863] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] watch_log_file = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.558988] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] wsgi_default_pool_size = 100 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.559126] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] wsgi_keep_alive = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.559263] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.559389] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] wsgi_server_debug = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 552.559572] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_concurrency.disable_process_locking = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.559666] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.559802] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.559933] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.560079] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.560218] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.560349] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.560496] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.connection_string = messaging:// {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.560632] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.enabled = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.560771] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.es_doc_type = notification {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.560903] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.es_scroll_size = 10000 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.561049] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.es_scroll_time = 2m {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.561185] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.filter_error_trace = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.561320] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.hmac_keys = **** {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.561457] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.sentinel_service_name = mymaster {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.561595] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.socket_timeout = 0.1 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.561725] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.trace_requests = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.561855] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler.trace_sqlalchemy = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.561996] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler_jaeger.process_tags = {} {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.562140] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler_jaeger.service_name_prefix = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.562274] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] profiler_otlp.service_name_prefix = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.562414] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.enforce_new_defaults = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.562667] env[66854]: WARNING oslo_config.cfg [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 552.562814] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.enforce_scope = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.562952] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.policy_default_rule = default {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.563108] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.563248] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.563387] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.563518] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.563646] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.563773] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.563904] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.564048] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_policy.remote_timeout = 60.0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.564194] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.564335] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] agent.extensions = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.564469] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.564604] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] service_providers.service_provider = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.564745] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.default_quota = -1 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.564884] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.565022] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.quota_floatingip = 50 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.565186] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.quota_network = 100 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.565324] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.quota_port = 500 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.565454] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.565581] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.quota_router = 10 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.565709] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.quota_security_group = 10 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.565836] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.565965] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.quota_subnet = 100 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.566110] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] QUOTAS.track_quota_usage = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.566254] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.566382] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep.group = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.566510] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep.helper_command = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.566641] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep.log_daemon_traceback = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.566774] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.566906] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep.thread_pool_size = 8 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.567047] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep.user = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.567233] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.567375] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_dhcp_release.group = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.567502] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_dhcp_release.helper_command = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.567630] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.567761] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.567888] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.568027] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_dhcp_release.user = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.568196] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.568327] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_ovs_vsctl.group = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.568452] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_ovs_vsctl.helper_command = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.568578] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.568707] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.568833] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.568960] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_ovs_vsctl.user = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.569109] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_namespace.capabilities = [21] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.569232] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_namespace.group = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.569357] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_namespace.helper_command = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.569483] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_namespace.log_daemon_traceback = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.569620] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.569743] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_namespace.thread_pool_size = 8 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.569866] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_namespace.user = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.569997] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_conntrack.capabilities = [12] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.570133] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_conntrack.group = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.570257] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_conntrack.helper_command = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.570382] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.570511] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.570641] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.570764] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_conntrack.user = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.570898] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_link.capabilities = [12, 21] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.571030] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_link.group = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.571156] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_link.helper_command = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.571311] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_link.log_daemon_traceback = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.571460] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.571592] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_link.thread_pool_size = 8 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.571724] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] privsep_link.user = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.571860] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.571999] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.572147] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.continue_on_failed_promotions = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.572276] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.dscp = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.572408] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.dscp_inherit = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.572543] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.force_mp_to_policy = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.572672] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.locking_coordinator_url = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.572801] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.log_agent_heartbeats = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.572930] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.logging_expire = 1 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.573083] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.573210] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.573345] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.polling_interval = 240 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.573474] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.573606] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.573743] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.report_interval = 30.0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.573882] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.574036] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.574177] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.574312] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.sync_skew = 60 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.574444] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.synchronization_queue_size = 20 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.574574] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT.use_helper_for_ns_read = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.574709] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] SECURITYGROUP.enable_ipset = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.574844] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] SECURITYGROUP.enable_security_group = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.574979] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.575147] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.575293] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] experimental.ipv6_pd_enabled = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.575445] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ml2.extension_drivers = ['port_security'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.575577] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ml2.external_network_type = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.575720] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.575858] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ml2.overlay_ip_version = 4 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.575993] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ml2.path_mtu = 8950 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.576145] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ml2.physical_network_mtus = {} {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.576290] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ml2.tenant_network_types = ['vlan'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.576428] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.576568] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ml2.type_drivers = ['vlan'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.576704] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT_CLI.neutron_port_id = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.576834] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.576963] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.577145] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.577288] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.577424] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.577559] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.577695] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.577828] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.578034] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.578213] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_login_password = **** {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.578361] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_login_port = 443 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.578515] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_login_user = admin {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.578684] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.578848] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.578989] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.579138] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.579312] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.579457] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.579596] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.579730] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.579864] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.579996] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.580148] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.580286] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.580423] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.580610] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.580752] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] vsphere.vsphere_login_password = VMware1! {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.580887] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.581026] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.581167] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.auth_section = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.581348] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.auth_type = password {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.581503] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.581638] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.certfile = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.581785] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.collect_timing = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.581956] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.endpoint_type = public {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.582126] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.insecure = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.582263] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.keyfile = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.582406] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.region_name = RegionOne {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.582540] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.split_loggers = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.582668] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] nova.timeout = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.582803] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.auth_section = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.582943] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.auth_type = password {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.583090] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.583223] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.certfile = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.583354] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.collect_timing = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.583490] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.endpoint_type = public {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.583621] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.insecure = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.583785] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.keyfile = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.583918] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.region_name = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.584060] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.split_loggers = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.584193] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] placement.timeout = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.584331] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.auth_section = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.584461] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.auth_type = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.584588] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.cafile = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.584712] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.certfile = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.584843] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.collect_timing = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.584969] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.connect_retries = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.585153] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.connect_retry_delay = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.585320] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.enable_notifications = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.585509] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.endpoint_override = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.585581] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.insecure = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.585709] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.interface = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.585834] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.keyfile = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.585966] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.max_version = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.586107] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.min_version = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.586236] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.region_name = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.586363] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.retriable_status_codes = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.586489] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.service_name = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.586613] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.service_type = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.586740] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.split_loggers = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.586867] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.status_code_retries = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.586992] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.status_code_retry_delay = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.587156] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.timeout = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.587293] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.valid_interfaces = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.587420] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ironic.version = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.587560] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] cli_script.dry_run = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.587697] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.587828] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.587961] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.588140] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.588286] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.588419] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.588549] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.588681] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.588812] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.588950] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.589092] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.589232] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.589371] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.589504] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.589635] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.589772] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.589950] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.590038] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.590178] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.590307] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.590435] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.590562] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.590689] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.590814] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.590941] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.591078] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.591214] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.591428] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.591619] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.591764] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.591898] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.ssl = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.592047] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.592190] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.592322] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.592458] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.592591] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.ssl_version = {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.592721] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.592860] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_notifications.driver = [] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.592993] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_notifications.retry = -1 {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.593153] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.593285] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] oslo_messaging_notifications.transport_url = **** {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 552.593386] env[66854]: DEBUG oslo_service.backend._eventlet.service [None req-06b2afad-3422-4fec-9ecf-b08ff8181c01 None None] ******************************************************************************** {{(pid=66854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 552.594488] env[66854]: DEBUG neutron.agent.securitygroups_rpc [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Init firewall settings (driver=nsxv3) {{(pid=66854) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 552.595765] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66854) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 552.596006] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] RPC agent_id: nsxm-l-01a.corp.local [ 552.598216] env[66854]: DEBUG dogpile.cache.region [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 552.598343] env[66854]: DEBUG dogpile.lock [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 552.598442] env[66854]: DEBUG dogpile.lock [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 552.598531] env[66854]: DEBUG dogpile.lock [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 552.598625] env[66854]: DEBUG dogpile.cache.region [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 552.598712] env[66854]: DEBUG dogpile.lock [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 552.598831] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 552.626063] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Session token - acquiring [ 552.627743] env[66854]: DEBUG networking_nsxv3.common.locking [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.627926] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.628053] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.628424] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.638651] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.914610] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 552.935973] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 552.936148] env[66854]: DEBUG dogpile.cache.region [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Cache value generated in 0.337 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 552.936277] env[66854]: DEBUG dogpile.lock [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 552.936366] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Activating Policy API Provider. [ 552.936562] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Looking for the default Infrastructure Rules. [ 553.007633] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Looking for the Default Layer3 Logged Drop Section. [ 553.022597] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 553.023125] env[66854]: DEBUG networking_nsxv3.common.locking [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.023325] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquiring lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.023432] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.023720] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired external semaphore "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.024069] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.541418] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.044636] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.546757] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Inventory metadata is going to be refreshed. [ 554.547276] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 555.298361] env[66854]: DEBUG networking_nsxv3.common.locking [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.298700] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.298700] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.298982] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.309982] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 555.311155] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.312058] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 555.331257] env[66854]: DEBUG networking_nsxv3.common.locking [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.331601] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.331601] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.331926] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.332035] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.332128] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 555.332221] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 555.332366] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 555.352643] env[66854]: DEBUG networking_nsxv3.common.locking [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.352920] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.352920] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.353233] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.353424] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.353571] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 555.376427] env[66854]: DEBUG networking_nsxv3.common.locking [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.376741] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.376741] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.377090] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.377299] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.377479] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 555.398683] env[66854]: DEBUG networking_nsxv3.common.locking [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.399021] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquiring lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.399021] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.399334] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired external semaphore "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.399479] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Releasing lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.399633] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 555.399737] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 555.399838] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 555.420647] env[66854]: DEBUG networking_nsxv3.common.locking [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.420935] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquiring lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.420935] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.421222] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired external semaphore "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.421359] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Releasing lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.421507] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 555.421613] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 555.421747] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 555.447084] env[66854]: DEBUG networking_nsxv3.common.locking [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.447432] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.447432] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.447675] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.447849] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.448013] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 555.448126] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 555.448227] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Inventory metadata have been refreshed. [ 555.448324] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Dryrun:True. Metadata refresh completed. [ 555.448441] env[66854]: DEBUG oslo_concurrency.lockutils [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Releasing lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.450110] env[66854]: INFO neutron.agent.agent_extensions_manager [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Loaded agent extensions: [] [ 555.450812] env[66854]: DEBUG neutron_lib.callbacks.manager [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66854) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 555.506209] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent RPC Daemon Started! [ 555.506363] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:0 started [ 555.506425] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent out of sync with plugin! [ 560.452175] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.452175] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.453249] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.453249] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.454391] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.454692] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.541712] env[66854]: INFO networking_nsxv3.common.synchronization [None req-4ae81c40-2fa0-4c99-888a-347e793f44ce demo admin] Enqueued Resource ID: 16f230cd-cdbc-4b76-9499-97a9bd881bd3 with Priority: HIGHEST for action security_group_rules [ 570.542298] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f230cd-cdbc-4b76-9499-97a9bd881bd3 with Priority: HIGHEST for action security_group_rules [ 570.542609] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16f230cd-cdbc-4b76-9499-97a9bd881bd3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.542735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16f230cd-cdbc-4b76-9499-97a9bd881bd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.542806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16f230cd-cdbc-4b76-9499-97a9bd881bd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.543162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16f230cd-cdbc-4b76-9499-97a9bd881bd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.543250] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16f230cd-cdbc-4b76-9499-97a9bd881bd3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.067348] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.067652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.067652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.067769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.067850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.067949] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16f230cd-cdbc-4b76-9499-97a9bd881bd3 already deleted. [ 571.068037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16f230cd-cdbc-4b76-9499-97a9bd881bd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.454142] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.454561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.454561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.454561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.454790] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.957633] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.460319] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.962738] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 573.962948] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 574.699078] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.699078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.699078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.699614] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.711192] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 574.711976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.712550] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 574.729475] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.729681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.729681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.729838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.729926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.730052] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 574.730127] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.730197] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 574.750019] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.750208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.750251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.750412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.750540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.750649] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 574.770273] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.770475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.770475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.770656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.770761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.770867] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 574.790240] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.790452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.790452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.790691] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.790805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.790925] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 574.790998] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.791083] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 574.806988] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.807229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.807229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.807403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.807485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.807589] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 574.807660] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.807731] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 574.829423] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.829631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.829631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.829802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.829903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.830028] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 574.830103] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.830169] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 574.830235] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 574.830310] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 574.830374] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 574.830457] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 574.830714] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 574.830780] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 574.830848] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 574.850447] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.850631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.850631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.850816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.850917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.851028] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 574.868959] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.869203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.869203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.869359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.869462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.881166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.543146] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 575.543338] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.544834] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 580.544834] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 585.545063] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 585.545063] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 590.546593] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 590.546957] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 595.547907] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 595.548237] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 596.821913] env[66854]: INFO networking_nsxv3.common.synchronization [None req-c3cff615-66a5-44fc-8d09-ab0cc56d03a0 None None] Enqueued Resource ID: 7350d8ac-a617-4d92-b2be-a28e2faf90f5 with Priority: HIGHEST for action port [ 596.822477] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7350d8ac-a617-4d92-b2be-a28e2faf90f5 with Priority: HIGHEST for action port [ 596.822781] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-7350d8ac-a617-4d92-b2be-a28e2faf90f5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.822895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7350d8ac-a617-4d92-b2be-a28e2faf90f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.822957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7350d8ac-a617-4d92-b2be-a28e2faf90f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.825655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7350d8ac-a617-4d92-b2be-a28e2faf90f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.825655] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7350d8ac-a617-4d92-b2be-a28e2faf90f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.949998] env[66854]: INFO networking_nsxv3.common.synchronization [None req-a6dd89f2-cea6-4cf0-96d7-2e1d079b67e5 None None] Enqueued Resource ID: 740d6f72-74c2-4b65-b8a2-bd5e454d1db2 with Priority: HIGHEST for action port [ 596.952009] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740d6f72-74c2-4b65-b8a2-bd5e454d1db2 with Priority: HIGHEST for action port [ 596.953990] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-740d6f72-74c2-4b65-b8a2-bd5e454d1db2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.953990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-740d6f72-74c2-4b65-b8a2-bd5e454d1db2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.953990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-740d6f72-74c2-4b65-b8a2-bd5e454d1db2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.954252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-740d6f72-74c2-4b65-b8a2-bd5e454d1db2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.954252] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('740d6f72-74c2-4b65-b8a2-bd5e454d1db2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.329312] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7350d8ac-a617-4d92-b2be-a28e2faf90f5 [ 597.329436] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.329571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.329627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.329844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.329934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.330044] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7350d8ac-a617-4d92-b2be-a28e2faf90f5 already deleted. [ 597.330128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7350d8ac-a617-4d92-b2be-a28e2faf90f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.457720] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 740d6f72-74c2-4b65-b8a2-bd5e454d1db2 [ 597.457948] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.458272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.458395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.458642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.458764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.458886] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:740d6f72-74c2-4b65-b8a2-bd5e454d1db2 already deleted. [ 597.458989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-740d6f72-74c2-4b65-b8a2-bd5e454d1db2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.180938] env[66854]: INFO networking_nsxv3.common.synchronization [None req-11c58625-ad94-4b50-8451-08c58afd6d82 None None] Enqueued Resource ID: d87d702a-40ab-41a7-9c71-1be33f14a6a2 with Priority: HIGHEST for action port [ 599.181326] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87d702a-40ab-41a7-9c71-1be33f14a6a2 with Priority: HIGHEST for action port [ 599.181766] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-d87d702a-40ab-41a7-9c71-1be33f14a6a2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.181909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d87d702a-40ab-41a7-9c71-1be33f14a6a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.181994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d87d702a-40ab-41a7-9c71-1be33f14a6a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.182271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d87d702a-40ab-41a7-9c71-1be33f14a6a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.182382] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d87d702a-40ab-41a7-9c71-1be33f14a6a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.318966] env[66854]: INFO networking_nsxv3.common.synchronization [None req-35bc4b57-604b-4745-80d4-17f2b8d18141 None None] Enqueued Resource ID: 7b46e287-2f8c-44e7-9fe0-fc005ae457c2 with Priority: HIGHEST for action port [ 599.319572] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b46e287-2f8c-44e7-9fe0-fc005ae457c2 with Priority: HIGHEST for action port [ 599.320804] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b46e287-2f8c-44e7-9fe0-fc005ae457c2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.320804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b46e287-2f8c-44e7-9fe0-fc005ae457c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.320804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b46e287-2f8c-44e7-9fe0-fc005ae457c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.320804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b46e287-2f8c-44e7-9fe0-fc005ae457c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.320804] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b46e287-2f8c-44e7-9fe0-fc005ae457c2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.686163] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d87d702a-40ab-41a7-9c71-1be33f14a6a2 [ 599.686163] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.686163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.686163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.686357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.686385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.686491] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d87d702a-40ab-41a7-9c71-1be33f14a6a2 already deleted. [ 599.686572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d87d702a-40ab-41a7-9c71-1be33f14a6a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.822222] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b46e287-2f8c-44e7-9fe0-fc005ae457c2 [ 599.822629] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.822629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.822629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.822853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.822918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.822969] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b46e287-2f8c-44e7-9fe0-fc005ae457c2 already deleted. [ 599.823062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b46e287-2f8c-44e7-9fe0-fc005ae457c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.468869] env[66854]: INFO networking_nsxv3.common.synchronization [None req-7f2df04b-d0f4-4961-8c18-2282bbdf35d7 None None] Enqueued Resource ID: 333d5ef0-4b63-4030-8298-46ad8b76f367 with Priority: HIGHEST for action port [ 601.470429] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333d5ef0-4b63-4030-8298-46ad8b76f367 with Priority: HIGHEST for action port [ 601.470429] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-333d5ef0-4b63-4030-8298-46ad8b76f367 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.470429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-333d5ef0-4b63-4030-8298-46ad8b76f367" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.470429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-333d5ef0-4b63-4030-8298-46ad8b76f367" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.470689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-333d5ef0-4b63-4030-8298-46ad8b76f367" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.470689] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('333d5ef0-4b63-4030-8298-46ad8b76f367',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.974882] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 333d5ef0-4b63-4030-8298-46ad8b76f367 [ 601.974882] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.974882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.975201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.975675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.975675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.975675] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:333d5ef0-4b63-4030-8298-46ad8b76f367 already deleted. [ 601.975675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-333d5ef0-4b63-4030-8298-46ad8b76f367" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.251592] env[66854]: INFO networking_nsxv3.common.synchronization [None req-977685bc-1b3e-40d2-8f4d-c21ec6b4f593 None None] Enqueued Resource ID: 27ff080b-9442-4ee0-8a49-0db81818355a with Priority: HIGHEST for action port [ 603.252144] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ff080b-9442-4ee0-8a49-0db81818355a with Priority: HIGHEST for action port [ 603.252445] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-27ff080b-9442-4ee0-8a49-0db81818355a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.252675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27ff080b-9442-4ee0-8a49-0db81818355a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.252675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27ff080b-9442-4ee0-8a49-0db81818355a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.252914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27ff080b-9442-4ee0-8a49-0db81818355a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.253009] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27ff080b-9442-4ee0-8a49-0db81818355a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.654709] env[66854]: INFO networking_nsxv3.common.synchronization [None req-4778e4d1-6d86-4b9c-abd1-dd4889b79284 None None] Enqueued Resource ID: bab87495-d678-4a46-a5ac-c705c8d72a7f with Priority: HIGHEST for action port [ 603.655291] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab87495-d678-4a46-a5ac-c705c8d72a7f with Priority: HIGHEST for action port [ 603.655589] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-bab87495-d678-4a46-a5ac-c705c8d72a7f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.655708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bab87495-d678-4a46-a5ac-c705c8d72a7f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.655792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bab87495-d678-4a46-a5ac-c705c8d72a7f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.656098] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bab87495-d678-4a46-a5ac-c705c8d72a7f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.656184] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bab87495-d678-4a46-a5ac-c705c8d72a7f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.756555] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27ff080b-9442-4ee0-8a49-0db81818355a [ 603.756805] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.756949] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.757008] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.757243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.757338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.757794] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27ff080b-9442-4ee0-8a49-0db81818355a already deleted. [ 603.757794] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27ff080b-9442-4ee0-8a49-0db81818355a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.987066] env[66854]: INFO networking_nsxv3.common.synchronization [None req-4eb332c3-db8e-41dc-b217-f800cb5585ff None None] Enqueued Resource ID: f113fde9-0ebf-49db-ab19-a31975dc51b3 with Priority: HIGHEST for action port [ 603.987361] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f113fde9-0ebf-49db-ab19-a31975dc51b3 with Priority: HIGHEST for action port [ 603.987925] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f113fde9-0ebf-49db-ab19-a31975dc51b3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.988115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f113fde9-0ebf-49db-ab19-a31975dc51b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.988183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f113fde9-0ebf-49db-ab19-a31975dc51b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.988371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f113fde9-0ebf-49db-ab19-a31975dc51b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.988454] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f113fde9-0ebf-49db-ab19-a31975dc51b3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.158224] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bab87495-d678-4a46-a5ac-c705c8d72a7f [ 604.158479] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.158623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.158703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.159061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.159061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.159139] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bab87495-d678-4a46-a5ac-c705c8d72a7f already deleted. [ 604.159745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bab87495-d678-4a46-a5ac-c705c8d72a7f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.494945] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f113fde9-0ebf-49db-ab19-a31975dc51b3 [ 604.494945] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.494945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.494945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.494945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.494945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.494945] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f113fde9-0ebf-49db-ab19-a31975dc51b3 already deleted. [ 604.494945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f113fde9-0ebf-49db-ab19-a31975dc51b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.049267] env[66854]: INFO networking_nsxv3.common.synchronization [None req-ef4d0e3e-5d89-4961-9cf9-f4f9ef5ed53e None None] Enqueued Resource ID: f4ab34c6-454d-4e99-8006-da65af5e43a4 with Priority: HIGHEST for action port [ 605.049267] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ab34c6-454d-4e99-8006-da65af5e43a4 with Priority: HIGHEST for action port [ 605.050285] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4ab34c6-454d-4e99-8006-da65af5e43a4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.050588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4ab34c6-454d-4e99-8006-da65af5e43a4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.050986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4ab34c6-454d-4e99-8006-da65af5e43a4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.051595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4ab34c6-454d-4e99-8006-da65af5e43a4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.051813] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4ab34c6-454d-4e99-8006-da65af5e43a4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.122609] env[66854]: INFO networking_nsxv3.common.synchronization [None req-c2cf659b-a977-43eb-b572-a9dda2b915aa None None] Enqueued Resource ID: ebfcc2ee-00e6-4740-b7f0-452448986f2e with Priority: HIGHEST for action port [ 605.123175] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfcc2ee-00e6-4740-b7f0-452448986f2e with Priority: HIGHEST for action port [ 605.124666] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebfcc2ee-00e6-4740-b7f0-452448986f2e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.124831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebfcc2ee-00e6-4740-b7f0-452448986f2e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.124990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebfcc2ee-00e6-4740-b7f0-452448986f2e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.125300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebfcc2ee-00e6-4740-b7f0-452448986f2e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.125617] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebfcc2ee-00e6-4740-b7f0-452448986f2e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.555336] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4ab34c6-454d-4e99-8006-da65af5e43a4 [ 605.555630] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.555695] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.555761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.555989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.556068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.556163] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4ab34c6-454d-4e99-8006-da65af5e43a4 already deleted. [ 605.556239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4ab34c6-454d-4e99-8006-da65af5e43a4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.629088] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebfcc2ee-00e6-4740-b7f0-452448986f2e [ 605.629345] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.629482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.629554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.629760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.629849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.629950] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebfcc2ee-00e6-4740-b7f0-452448986f2e already deleted. [ 605.630043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebfcc2ee-00e6-4740-b7f0-452448986f2e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.758294] env[66854]: INFO networking_nsxv3.common.synchronization [None req-df846fa6-8f8f-45b8-9c24-ae3ea7ffefb5 None None] Enqueued Resource ID: d1b72c7d-ef38-4612-b8ae-40bf8f13ceb8 with Priority: HIGHEST for action port [ 606.758680] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b72c7d-ef38-4612-b8ae-40bf8f13ceb8 with Priority: HIGHEST for action port [ 606.759021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1b72c7d-ef38-4612-b8ae-40bf8f13ceb8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.760263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1b72c7d-ef38-4612-b8ae-40bf8f13ceb8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.760263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1b72c7d-ef38-4612-b8ae-40bf8f13ceb8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.760263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1b72c7d-ef38-4612-b8ae-40bf8f13ceb8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.760263] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1b72c7d-ef38-4612-b8ae-40bf8f13ceb8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.267405] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1b72c7d-ef38-4612-b8ae-40bf8f13ceb8 [ 607.267405] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.267405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.267405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.267405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.267405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.267405] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1b72c7d-ef38-4612-b8ae-40bf8f13ceb8 already deleted. [ 607.267405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1b72c7d-ef38-4612-b8ae-40bf8f13ceb8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.227506] env[66854]: INFO networking_nsxv3.common.synchronization [None req-359c22fa-8042-4d2f-ba60-f8fccca2ec08 None None] Enqueued Resource ID: 65484e0f-7bf2-483a-bcbc-491d81d23a65 with Priority: HIGHEST for action port [ 608.229913] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65484e0f-7bf2-483a-bcbc-491d81d23a65 with Priority: HIGHEST for action port [ 608.230669] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-65484e0f-7bf2-483a-bcbc-491d81d23a65 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.230800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65484e0f-7bf2-483a-bcbc-491d81d23a65" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.230887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65484e0f-7bf2-483a-bcbc-491d81d23a65" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.231191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65484e0f-7bf2-483a-bcbc-491d81d23a65" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.231275] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65484e0f-7bf2-483a-bcbc-491d81d23a65',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.734504] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65484e0f-7bf2-483a-bcbc-491d81d23a65 [ 608.734504] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.734504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.734504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.734504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.734851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.734851] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65484e0f-7bf2-483a-bcbc-491d81d23a65 already deleted. [ 608.734851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65484e0f-7bf2-483a-bcbc-491d81d23a65" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.220535] env[66854]: INFO networking_nsxv3.common.synchronization [None req-8b0d8b8d-ed87-4e5f-b46e-38a52b1cbea3 None None] Enqueued Resource ID: 959bca7b-665b-42f4-a444-aa5295b5edb7 with Priority: HIGHEST for action port [ 610.221435] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 959bca7b-665b-42f4-a444-aa5295b5edb7 with Priority: HIGHEST for action port [ 610.222171] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-959bca7b-665b-42f4-a444-aa5295b5edb7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.222427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-959bca7b-665b-42f4-a444-aa5295b5edb7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.222427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-959bca7b-665b-42f4-a444-aa5295b5edb7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.222705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-959bca7b-665b-42f4-a444-aa5295b5edb7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.222952] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('959bca7b-665b-42f4-a444-aa5295b5edb7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.240123] env[66854]: INFO networking_nsxv3.common.synchronization [None req-4685cee9-bc1f-47f3-bf14-051dd2247007 None None] Enqueued Resource ID: 12ae19b7-9777-4f73-9eee-63681aba4148 with Priority: HIGHEST for action port [ 610.242523] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12ae19b7-9777-4f73-9eee-63681aba4148 with Priority: HIGHEST for action port [ 610.243371] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-12ae19b7-9777-4f73-9eee-63681aba4148 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.243649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12ae19b7-9777-4f73-9eee-63681aba4148" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.243810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12ae19b7-9777-4f73-9eee-63681aba4148" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.244153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12ae19b7-9777-4f73-9eee-63681aba4148" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.244348] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12ae19b7-9777-4f73-9eee-63681aba4148',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.725361] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 959bca7b-665b-42f4-a444-aa5295b5edb7 [ 610.726477] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.726477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.726477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.726477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.726477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.726477] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:959bca7b-665b-42f4-a444-aa5295b5edb7 already deleted. [ 610.726477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-959bca7b-665b-42f4-a444-aa5295b5edb7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.747663] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12ae19b7-9777-4f73-9eee-63681aba4148 [ 610.747663] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.747663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.747663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.747663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.747663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.747663] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12ae19b7-9777-4f73-9eee-63681aba4148 already deleted. [ 610.747663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12ae19b7-9777-4f73-9eee-63681aba4148" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.040167] env[66854]: INFO networking_nsxv3.common.synchronization [None req-eaebb3c1-aab0-4876-b5dd-bf724bb4823a None None] Enqueued Resource ID: 531a732d-a643-425a-bf77-3ae89e4c1ab6 with Priority: HIGHEST for action port [ 611.040796] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531a732d-a643-425a-bf77-3ae89e4c1ab6 with Priority: HIGHEST for action port [ 611.041150] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-531a732d-a643-425a-bf77-3ae89e4c1ab6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.041288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-531a732d-a643-425a-bf77-3ae89e4c1ab6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.041383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-531a732d-a643-425a-bf77-3ae89e4c1ab6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.041652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-531a732d-a643-425a-bf77-3ae89e4c1ab6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.041741] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('531a732d-a643-425a-bf77-3ae89e4c1ab6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.544986] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 531a732d-a643-425a-bf77-3ae89e4c1ab6 [ 611.545268] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.546121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.546121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.546121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.546121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.546121] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:531a732d-a643-425a-bf77-3ae89e4c1ab6 already deleted. [ 611.546121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-531a732d-a643-425a-bf77-3ae89e4c1ab6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.643020] env[66854]: INFO networking_nsxv3.common.synchronization [req-b21d3ce9-2766-4b1e-8d5b-01f1be72fcbe req-0c89480f-ee1c-4777-960c-5c48b8e6ed70 tempest-MultipleCreateTestJSON-768742875 tempest-MultipleCreateTestJSON-768742875-project-member] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 611.643020] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 611.643020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.643020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.643020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.643020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.643020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.643020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.643020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.643020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.643020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.643020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.963691] env[66854]: INFO networking_nsxv3.common.synchronization [None req-a2f6a51d-3edd-4d64-b11b-54d2a8cf27d9 None None] Enqueued Resource ID: 628258cf-d6a7-427a-b21c-3d7b78737e39 with Priority: HIGHEST for action port [ 611.964346] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 628258cf-d6a7-427a-b21c-3d7b78737e39 with Priority: HIGHEST for action port [ 611.964669] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-628258cf-d6a7-427a-b21c-3d7b78737e39 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.966433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-628258cf-d6a7-427a-b21c-3d7b78737e39" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.966433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-628258cf-d6a7-427a-b21c-3d7b78737e39" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.966433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-628258cf-d6a7-427a-b21c-3d7b78737e39" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.966433] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('628258cf-d6a7-427a-b21c-3d7b78737e39',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.144324] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.144618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.144698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.145057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.145127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.145397] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.145480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.145524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.145761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.145847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.145975] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 already deleted. [ 612.146076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.471032] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 628258cf-d6a7-427a-b21c-3d7b78737e39 [ 612.472412] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.472682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.472837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.473182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.473368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.473554] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:628258cf-d6a7-427a-b21c-3d7b78737e39 already deleted. [ 612.474318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-628258cf-d6a7-427a-b21c-3d7b78737e39" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.485076] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.485076] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.485076] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.485076] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.485076] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.485076] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.485076] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.485076] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.485076] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.485076] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.485076] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.485076] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.485076] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.485724] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.485724] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.485724] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.506596] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.507547] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.507547] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.507547] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.507547] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-f9c4c96d-38a0-4ad8-939e-530f6ca0a594 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.509756] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-f9c4c96d-38a0-4ad8-939e-530f6ca0a594" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.509962] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-f9c4c96d-38a0-4ad8-939e-530f6ca0a594" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.510342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-f9c4c96d-38a0-4ad8-939e-530f6ca0a594" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.510427] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9c4c96d-38a0-4ad8-939e-530f6ca0a594',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.014022] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.014385] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.014385] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.014928] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.014928] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.014995] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port f9c4c96d-38a0-4ad8-939e-530f6ca0a594 not found, creating... [ 613.015806] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.015806] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.015806] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.015806] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.015806] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.016889] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.016889] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.016889] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.016889] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.016889] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.017339] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: f9c4c96d-38a0-4ad8-939e-530f6ca0a594 is going to be created. [ 613.039154] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.039154] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.039154] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.039432] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.039730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.040056] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-f9c4c96d-38a0-4ad8-939e-530f6ca0a594" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.426847] env[66854]: INFO networking_nsxv3.common.synchronization [None req-3c679479-a6a5-4ad2-bd2b-31a6465c5c00 None None] Enqueued Resource ID: 36c45f57-fa61-44fb-9ee6-4fa321506a08 with Priority: HIGHEST for action port [ 613.427143] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c45f57-fa61-44fb-9ee6-4fa321506a08 with Priority: HIGHEST for action port [ 613.427723] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-36c45f57-fa61-44fb-9ee6-4fa321506a08 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.427852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36c45f57-fa61-44fb-9ee6-4fa321506a08" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.427921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36c45f57-fa61-44fb-9ee6-4fa321506a08" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.428208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36c45f57-fa61-44fb-9ee6-4fa321506a08" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.428292] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36c45f57-fa61-44fb-9ee6-4fa321506a08',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.814990] env[66854]: INFO networking_nsxv3.common.synchronization [req-b21d3ce9-2766-4b1e-8d5b-01f1be72fcbe req-6ad5ee9f-7340-4f85-8659-200bd12f1d0d service nova] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_rules [ 613.815070] env[66854]: INFO networking_nsxv3.common.synchronization [req-b21d3ce9-2766-4b1e-8d5b-01f1be72fcbe req-6ad5ee9f-7340-4f85-8659-200bd12f1d0d service nova] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 613.815212] env[66854]: INFO networking_nsxv3.common.synchronization [req-b21d3ce9-2766-4b1e-8d5b-01f1be72fcbe req-6ad5ee9f-7340-4f85-8659-200bd12f1d0d service nova] Enqueued Resource ID: f9c4c96d-38a0-4ad8-939e-530f6ca0a594 with Priority: HIGHEST for action port [ 613.815432] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_rules [ 613.815591] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 613.816391] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c4c96d-38a0-4ad8-939e-530f6ca0a594 with Priority: HIGHEST for action port [ 613.816391] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.816532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.816577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.816977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.816977] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.817831] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.819408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.819408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.819408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.819408] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.819408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.819408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.819408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.819408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.819408] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.820926] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9c4c96d-38a0-4ad8-939e-530f6ca0a594 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.820926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9c4c96d-38a0-4ad8-939e-530f6ca0a594" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.820926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9c4c96d-38a0-4ad8-939e-530f6ca0a594" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.822928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9c4c96d-38a0-4ad8-939e-530f6ca0a594" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.822928] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9c4c96d-38a0-4ad8-939e-530f6ca0a594',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.929794] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36c45f57-fa61-44fb-9ee6-4fa321506a08 [ 613.930081] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.930219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.930349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.930633] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.930822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.930892] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36c45f57-fa61-44fb-9ee6-4fa321506a08 already deleted. [ 613.930979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36c45f57-fa61-44fb-9ee6-4fa321506a08" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.324276] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.324276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.333588] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.335761] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9c4c96d-38a0-4ad8-939e-530f6ca0a594 with status ACTIVE [ 614.336009] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.336147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.336214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.336429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.336520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.336911] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.336911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.337056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.337114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.337195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.337375] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.337468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.337543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.337653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.337723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.337823] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9c4c96d-38a0-4ad8-939e-530f6ca0a594 is going to be updated. [ 614.366403] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.366556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.366616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.366830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.367184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.367184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9c4c96d-38a0-4ad8-939e-530f6ca0a594" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.491596] env[66854]: INFO networking_nsxv3.common.synchronization [req-064ba810-2ba2-495f-979e-d3c6d7af8b25 req-6ba99667-a1ea-44a9-999b-8782ee61bd59 tempest-FloatingIPsAssociationTestJSON-1643548393 tempest-FloatingIPsAssociationTestJSON-1643548393-project-member] Enqueued Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 614.492737] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 614.493084] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.493260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.493386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.493642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.493861] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.494011] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.494115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.494305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.494487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.494556] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.839805] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.912255] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-272 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.912464] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-272" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.912582] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-272" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.912920] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-272" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.913669] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.913896] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.914065] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.914270] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.914414] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.914632] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.914740] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.914880] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.914981] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.915152] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.915234] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.915418] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.936287] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.936460] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.936601] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.936822] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-272" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.937164] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-3d224e1a-7fd3-4380-9ea0-de44727aa9bc taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.937354] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-3d224e1a-7fd3-4380-9ea0-de44727aa9bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.937438] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-3d224e1a-7fd3-4380-9ea0-de44727aa9bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.937847] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-3d224e1a-7fd3-4380-9ea0-de44727aa9bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.937979] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d224e1a-7fd3-4380-9ea0-de44727aa9bc',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.997494] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.997494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.997494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.997494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.997494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.998694] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.998694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.998694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.998694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.998694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.998694] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b68d89c-9278-4047-a0c4-e471d31223ed already deleted. [ 614.998694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.058555] env[66854]: INFO networking_nsxv3.common.synchronization [None req-2e86e75e-9dea-44e3-84c7-d7ef94c7ea29 None None] Enqueued Resource ID: 0f4ca54d-4f68-4ee0-9832-527aa40a491c with Priority: HIGHEST for action port [ 615.059748] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f4ca54d-4f68-4ee0-9832-527aa40a491c with Priority: HIGHEST for action port [ 615.060429] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f4ca54d-4f68-4ee0-9832-527aa40a491c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.060905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f4ca54d-4f68-4ee0-9832-527aa40a491c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.060995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f4ca54d-4f68-4ee0-9832-527aa40a491c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.061277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f4ca54d-4f68-4ee0-9832-527aa40a491c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.061366] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f4ca54d-4f68-4ee0-9832-527aa40a491c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.342984] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.343309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.343309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.343464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.344314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.344314] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be created. [ 615.373959] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.373959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.373959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.373959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.373959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.382170] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: UNINITIALIZED for 2s [ 615.440346] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.440992] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.440992] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.440992] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.441711] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.441894] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 3d224e1a-7fd3-4380-9ea0-de44727aa9bc not found, creating... [ 615.442207] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.442378] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.443191] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.443191] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.443413] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.444083] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.444243] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.444358] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.444585] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.444715] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.446232] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 3d224e1a-7fd3-4380-9ea0-de44727aa9bc is going to be created. [ 615.467304] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.469091] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.469690] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.470196] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.470196] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.470318] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-3d224e1a-7fd3-4380-9ea0-de44727aa9bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.564220] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f4ca54d-4f68-4ee0-9832-527aa40a491c [ 615.564460] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.564598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.564669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.565570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.565570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.565570] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f4ca54d-4f68-4ee0-9832-527aa40a491c already deleted. [ 615.565570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f4ca54d-4f68-4ee0-9832-527aa40a491c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.043218] env[66854]: INFO networking_nsxv3.common.synchronization [None req-1a98ccad-f89d-4e71-a3ff-b6c1faaa02f6 None None] Enqueued Resource ID: cfd14df5-4985-4e02-a851-50cf4e2beaa7 with Priority: HIGHEST for action port [ 616.044548] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfd14df5-4985-4e02-a851-50cf4e2beaa7 with Priority: HIGHEST for action port [ 616.044548] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfd14df5-4985-4e02-a851-50cf4e2beaa7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.044548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfd14df5-4985-4e02-a851-50cf4e2beaa7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.044548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfd14df5-4985-4e02-a851-50cf4e2beaa7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.044869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfd14df5-4985-4e02-a851-50cf4e2beaa7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.044869] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd14df5-4985-4e02-a851-50cf4e2beaa7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.240856] env[66854]: INFO networking_nsxv3.common.synchronization [req-064ba810-2ba2-495f-979e-d3c6d7af8b25 req-5b99454e-9135-4381-b069-1b55ac82fff1 service nova] Enqueued Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_rules [ 616.241037] env[66854]: INFO networking_nsxv3.common.synchronization [req-064ba810-2ba2-495f-979e-d3c6d7af8b25 req-5b99454e-9135-4381-b069-1b55ac82fff1 service nova] Enqueued Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 616.241172] env[66854]: INFO networking_nsxv3.common.synchronization [req-064ba810-2ba2-495f-979e-d3c6d7af8b25 req-5b99454e-9135-4381-b069-1b55ac82fff1 service nova] Enqueued Resource ID: 3d224e1a-7fd3-4380-9ea0-de44727aa9bc with Priority: HIGHEST for action port [ 616.241669] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_rules [ 616.241831] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 616.241944] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d224e1a-7fd3-4380-9ea0-de44727aa9bc with Priority: HIGHEST for action port [ 616.242468] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.242600] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.242676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.242927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.243033] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.243869] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.243988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.244068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.244239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.244399] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.244478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.244671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.244671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.244759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.244852] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.245721] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d224e1a-7fd3-4380-9ea0-de44727aa9bc taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.245721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d224e1a-7fd3-4380-9ea0-de44727aa9bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.245902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d224e1a-7fd3-4380-9ea0-de44727aa9bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.245902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d224e1a-7fd3-4380-9ea0-de44727aa9bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.245960] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d224e1a-7fd3-4380-9ea0-de44727aa9bc',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.548851] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfd14df5-4985-4e02-a851-50cf4e2beaa7 [ 616.549137] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.549256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.549327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.549535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.549622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.549718] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfd14df5-4985-4e02-a851-50cf4e2beaa7 already deleted. [ 616.549799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfd14df5-4985-4e02-a851-50cf4e2beaa7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.752020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.752020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.752020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.752020] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d224e1a-7fd3-4380-9ea0-de44727aa9bc with status ACTIVE [ 616.752020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.752020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.752020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.752020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.752020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.752020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.752020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.752020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.752020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.752020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.752768] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.752768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.752768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.753218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.753424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.753600] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d224e1a-7fd3-4380-9ea0-de44727aa9bc is going to be updated. [ 616.782172] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.782172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.782172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.782172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.782172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.782172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d224e1a-7fd3-4380-9ea0-de44727aa9bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.970978] env[66854]: INFO networking_nsxv3.common.synchronization [req-b21d3ce9-2766-4b1e-8d5b-01f1be72fcbe req-eaeaef5e-6619-475a-8931-a2f52c5d7e65 tempest-MultipleCreateTestJSON-768742875 tempest-MultipleCreateTestJSON-768742875-project-member] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 616.972357] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 616.972803] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.972803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.260176] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.393226] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 617.393226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.393226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.393226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.393226] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.393226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.393226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.393226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.393704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.393704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.393704] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.394595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.394595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.394903] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.394903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.394903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.395289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.395427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.395638] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.518061] env[66854]: INFO networking_nsxv3.common.synchronization [None req-3d8e31e6-7a08-4c66-a301-c716e7cec172 None None] Enqueued Resource ID: 007b409b-6dc0-455b-8ceb-c6f9af52de8b with Priority: HIGHEST for action port [ 617.518780] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007b409b-6dc0-455b-8ceb-c6f9af52de8b with Priority: HIGHEST for action port [ 617.518856] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-007b409b-6dc0-455b-8ceb-c6f9af52de8b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.518968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-007b409b-6dc0-455b-8ceb-c6f9af52de8b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.523119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-007b409b-6dc0-455b-8ceb-c6f9af52de8b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.523585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-007b409b-6dc0-455b-8ceb-c6f9af52de8b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.523585] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('007b409b-6dc0-455b-8ceb-c6f9af52de8b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.762323] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.762703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.762703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.762703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.762818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.762950] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b68d89c-9278-4047-a0c4-e471d31223ed is going to be created. [ 617.790036] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.790036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.790249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.790281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.790438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.799357] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: UNINITIALIZED for 2s [ 617.901025] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.901025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.901025] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.901025] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.901025] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.901025] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.902361] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.903462] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.903884] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.904456] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.904835] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.908133] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.908133] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.908133] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.908133] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.908133] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.908133] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.908133] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.908892] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.928687] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.928921] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.929190] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.929289] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.929785] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-f8e389e7-d468-408e-b88e-236f5a4e5653 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.930009] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-f8e389e7-d468-408e-b88e-236f5a4e5653" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.930297] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-f8e389e7-d468-408e-b88e-236f5a4e5653" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.930711] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-f8e389e7-d468-408e-b88e-236f5a4e5653" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.930976] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8e389e7-d468-408e-b88e-236f5a4e5653',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.026648] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 007b409b-6dc0-455b-8ceb-c6f9af52de8b [ 618.026648] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.027383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.027383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.027506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.027545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.027731] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:007b409b-6dc0-455b-8ceb-c6f9af52de8b already deleted. [ 618.027825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-007b409b-6dc0-455b-8ceb-c6f9af52de8b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.136721] env[66854]: INFO networking_nsxv3.common.synchronization [None req-6e5506bf-f6f0-4775-a026-81a43a8b999d None None] Enqueued Resource ID: 1dcb2318-a90e-43ee-9de1-4f4a9f7caa25 with Priority: HIGHEST for action port [ 618.137292] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dcb2318-a90e-43ee-9de1-4f4a9f7caa25 with Priority: HIGHEST for action port [ 618.138279] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dcb2318-a90e-43ee-9de1-4f4a9f7caa25 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.138279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dcb2318-a90e-43ee-9de1-4f4a9f7caa25" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.138279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dcb2318-a90e-43ee-9de1-4f4a9f7caa25" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.138279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dcb2318-a90e-43ee-9de1-4f4a9f7caa25" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.138279] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dcb2318-a90e-43ee-9de1-4f4a9f7caa25',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.411399] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.434176] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.434398] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.434980] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.435143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.435319] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.435472] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port f8e389e7-d468-408e-b88e-236f5a4e5653 not found, creating... [ 618.435782] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.436047] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.436208] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.436456] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.436595] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.436885] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.437045] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.437156] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.437361] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.437485] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.437618] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: f8e389e7-d468-408e-b88e-236f5a4e5653 is going to be created. [ 618.458397] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.458607] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.458726] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.458987] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.459223] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.459444] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-f8e389e7-d468-408e-b88e-236f5a4e5653" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.613712] env[66854]: INFO networking_nsxv3.common.synchronization [None req-cbb42620-fbb6-4f7b-aa32-7d08b4f8ed7e None None] Enqueued Resource ID: a89ac9a8-1ae2-4810-8e54-e36509ad888f with Priority: HIGHEST for action port [ 618.614462] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89ac9a8-1ae2-4810-8e54-e36509ad888f with Priority: HIGHEST for action port [ 618.614904] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-a89ac9a8-1ae2-4810-8e54-e36509ad888f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.614969] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a89ac9a8-1ae2-4810-8e54-e36509ad888f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.617494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a89ac9a8-1ae2-4810-8e54-e36509ad888f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.618550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a89ac9a8-1ae2-4810-8e54-e36509ad888f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.618550] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a89ac9a8-1ae2-4810-8e54-e36509ad888f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.641120] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1dcb2318-a90e-43ee-9de1-4f4a9f7caa25 [ 618.641366] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.641496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.641566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.642052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.642052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.642198] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1dcb2318-a90e-43ee-9de1-4f4a9f7caa25 already deleted. [ 618.642294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dcb2318-a90e-43ee-9de1-4f4a9f7caa25" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.916075] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.916075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.916075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.916075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.916075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.916075] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 618.951664] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.951941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.952162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.952317] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.952512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.968086] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 619.120510] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a89ac9a8-1ae2-4810-8e54-e36509ad888f [ 619.120892] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.121128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.121231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.121476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.121599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.121725] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a89ac9a8-1ae2-4810-8e54-e36509ad888f already deleted. [ 619.121836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a89ac9a8-1ae2-4810-8e54-e36509ad888f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.406828] env[66854]: INFO networking_nsxv3.common.synchronization [None req-d7caa5e9-5db9-4d39-a102-bda758789065 None None] Enqueued Resource ID: 5014ea1f-a2be-484e-90c8-a98dc44a947f with Priority: HIGHEST for action port [ 619.407374] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5014ea1f-a2be-484e-90c8-a98dc44a947f with Priority: HIGHEST for action port [ 619.407674] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-5014ea1f-a2be-484e-90c8-a98dc44a947f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.407797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5014ea1f-a2be-484e-90c8-a98dc44a947f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.407868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5014ea1f-a2be-484e-90c8-a98dc44a947f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.408320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5014ea1f-a2be-484e-90c8-a98dc44a947f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.408411] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5014ea1f-a2be-484e-90c8-a98dc44a947f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.630099] env[66854]: INFO networking_nsxv3.common.synchronization [req-b21d3ce9-2766-4b1e-8d5b-01f1be72fcbe req-9e2d5477-6e67-4505-88f7-634e81872008 service nova] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_rules [ 619.630453] env[66854]: INFO networking_nsxv3.common.synchronization [req-b21d3ce9-2766-4b1e-8d5b-01f1be72fcbe req-9e2d5477-6e67-4505-88f7-634e81872008 service nova] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 619.630797] env[66854]: INFO networking_nsxv3.common.synchronization [req-b21d3ce9-2766-4b1e-8d5b-01f1be72fcbe req-9e2d5477-6e67-4505-88f7-634e81872008 service nova] Enqueued Resource ID: f8e389e7-d468-408e-b88e-236f5a4e5653 with Priority: HIGHEST for action port [ 619.632651] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_rules [ 619.633058] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 619.633808] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e389e7-d468-408e-b88e-236f5a4e5653 with Priority: HIGHEST for action port [ 619.633808] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.634013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.634287] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.634287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.634474] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8e389e7-d468-408e-b88e-236f5a4e5653 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.634474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8e389e7-d468-408e-b88e-236f5a4e5653" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.634580] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8e389e7-d468-408e-b88e-236f5a4e5653" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.635456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8e389e7-d468-408e-b88e-236f5a4e5653" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.635456] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8e389e7-d468-408e-b88e-236f5a4e5653',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.811653] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: SUCCESS [ 619.811907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.812076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.812304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.812501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.812690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.812690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.812869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.812915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.812990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.813093] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.909959] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5014ea1f-a2be-484e-90c8-a98dc44a947f [ 619.910976] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.911326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.911326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.911497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.911611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.911769] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5014ea1f-a2be-484e-90c8-a98dc44a947f already deleted. [ 619.911870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5014ea1f-a2be-484e-90c8-a98dc44a947f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.136989] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8e389e7-d468-408e-b88e-236f5a4e5653 with status ACTIVE [ 620.138548] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.138548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.138548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.138548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.138548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.138548] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.138548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.138548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.138948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.138948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.138948] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.138948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.139154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.139154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.139234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.139316] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8e389e7-d468-408e-b88e-236f5a4e5653 is going to be updated. [ 620.162210] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.162210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.162210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.162457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.162457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.162571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8e389e7-d468-408e-b88e-236f5a4e5653" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.268904] env[66854]: INFO networking_nsxv3.common.synchronization [None req-2613fd20-d490-45e1-b380-8075b1ffec3f None None] Enqueued Resource ID: 2ede5ac2-1658-4924-bf54-a8e33c7390d6 with Priority: HIGHEST for action port [ 620.269040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ede5ac2-1658-4924-bf54-a8e33c7390d6 with Priority: HIGHEST for action port [ 620.269396] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ede5ac2-1658-4924-bf54-a8e33c7390d6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.269541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ede5ac2-1658-4924-bf54-a8e33c7390d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.269541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ede5ac2-1658-4924-bf54-a8e33c7390d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.269755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ede5ac2-1658-4924-bf54-a8e33c7390d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.269828] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ede5ac2-1658-4924-bf54-a8e33c7390d6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.319538] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.319538] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.319538] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.319538] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.319538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.320089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.320089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.320089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.320089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.320089] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.774436] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ede5ac2-1658-4924-bf54-a8e33c7390d6 [ 620.774690] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.774849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.774933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.776038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.776038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.776038] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ede5ac2-1658-4924-bf54-a8e33c7390d6 already deleted. [ 620.776038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ede5ac2-1658-4924-bf54-a8e33c7390d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.821506] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b68d89c-9278-4047-a0c4-e471d31223ed: rpc.has_security_group_logging(os_id): False [ 620.844371] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.845215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.845311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.845543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.845608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.845892] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.846026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.846067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.846236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.846311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.846519] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.846610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.846700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.846842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.846953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.847103] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.847201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.848289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.848289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.848289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.848289] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b68d89c-9278-4047-a0c4-e471d31223ed is going to be created. [ 620.911385] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.911567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.911705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.911831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.912041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.924722] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: IN_PROGRESS for 2s [ 620.996616] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 620.998163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.998163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.998163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.998602] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.998742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.998927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.999355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.999511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.999562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.999812] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.999905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.999905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.000891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.000891] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.000891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.000891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.000891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.000891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.000891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.000891] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.001848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.002054] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.002236] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.002343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.002403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.002543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.002618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.002713] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.064815] env[66854]: INFO networking_nsxv3.common.synchronization [req-2b485972-a209-46b8-a38e-91f713ad9cf4 req-480ededa-b9b2-4673-8464-d080afb322b1 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 621.067674] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 621.067674] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.067674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.067674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.067674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.067674] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.067674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.067674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.067674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.068114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.068114] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.195852] env[66854]: INFO networking_nsxv3.common.synchronization [None req-749cb549-04e5-43c6-be1c-81aa03cbb500 tempest-VolumesAssistedSnapshotsTest-1107862057 tempest-VolumesAssistedSnapshotsTest-1107862057-project-member] Enqueued Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_rules [ 621.195852] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_rules [ 621.195852] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-004af225-cfe6-418e-bf9b-b21fc4fcd911 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.195852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.195852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.195852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.197841] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.466432] env[66854]: INFO networking_nsxv3.common.synchronization [None req-d353f6f3-91d2-4db8-8534-2dbd1cfb1a77 tempest-VolumesAssistedSnapshotsTest-1107862057 tempest-VolumesAssistedSnapshotsTest-1107862057-project-member] Enqueued Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_rules [ 621.466596] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_rules [ 621.467343] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-004af225-cfe6-418e-bf9b-b21fc4fcd911 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.467586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.504964] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1871982-9cf3-4b58-bd63-59badb5546d2: rpc.has_security_group_logging(os_id): False [ 621.506506] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.525493] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.525649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.525857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.526265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.526373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.526669] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.526729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.526776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.527015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.527015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.527224] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.527322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.527386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.527531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.527608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.527791] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.527936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.527978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.528103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.528176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.528263] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be created. [ 621.572468] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.572468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.572468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.572468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.572468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.572814] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.572814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.572814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.572814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.572950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.572950] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 already deleted. [ 621.573023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.585697] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.586101] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.586560] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.587269] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.587721] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.587721] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.587859] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.588504] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.588663] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.588875] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.588984] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.589098] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.589219] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.589287] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.589385] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.589519] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.594190] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.594190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.594190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.594190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.594190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.623303] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.623472] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.623628] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.623863] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.624227] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-c3aa7f96-7b96-4bd4-a567-806f10bb024e taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.624402] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-c3aa7f96-7b96-4bd4-a567-806f10bb024e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.624519] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-c3aa7f96-7b96-4bd4-a567-806f10bb024e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.624847] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-c3aa7f96-7b96-4bd4-a567-806f10bb024e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.625792] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3aa7f96-7b96-4bd4-a567-806f10bb024e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.629553] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 621.730136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.730136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.730136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.730977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.731092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.731194] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 already deleted. [ 621.731276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.731417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.731606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.733037] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.812039] env[66854]: INFO networking_nsxv3.common.synchronization [None req-7826b51b-4c20-48b9-977e-e8b4c2a8b220 None None] Enqueued Resource ID: 10f4ddf0-dcfa-477c-9b2e-29a59bdda051 with Priority: HIGHEST for action port [ 621.812584] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10f4ddf0-dcfa-477c-9b2e-29a59bdda051 with Priority: HIGHEST for action port [ 621.812894] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-10f4ddf0-dcfa-477c-9b2e-29a59bdda051 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.813030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10f4ddf0-dcfa-477c-9b2e-29a59bdda051" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.813101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10f4ddf0-dcfa-477c-9b2e-29a59bdda051" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.813352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10f4ddf0-dcfa-477c-9b2e-29a59bdda051" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.813436] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10f4ddf0-dcfa-477c-9b2e-29a59bdda051',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.822762] env[66854]: INFO networking_nsxv3.common.synchronization [req-2018b42b-6e9f-408e-8d7d-9d4c3ac38372 req-d4bb9d67-f960-498c-ae6a-66cb4ca450cb tempest-DeleteServersAdminTestJSON-1100910551 tempest-DeleteServersAdminTestJSON-1100910551-project-member] Enqueued Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 621.823920] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 621.823920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.823920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.823920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.824236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.824575] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.824575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.824575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.824732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.824898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.826587] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.957182] env[66854]: INFO networking_nsxv3.common.synchronization [None req-2d325811-3a61-41cf-b476-fc8a3221c071 None None] Enqueued Resource ID: 4086b76a-3e95-4d23-84c4-3a1aea03e049 with Priority: HIGHEST for action port [ 621.957806] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4086b76a-3e95-4d23-84c4-3a1aea03e049 with Priority: HIGHEST for action port [ 621.958119] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4086b76a-3e95-4d23-84c4-3a1aea03e049 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.958251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4086b76a-3e95-4d23-84c4-3a1aea03e049" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.958344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4086b76a-3e95-4d23-84c4-3a1aea03e049" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.958583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4086b76a-3e95-4d23-84c4-3a1aea03e049" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.958671] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4086b76a-3e95-4d23-84c4-3a1aea03e049',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.009192] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.127441] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.127686] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.127835] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.128151] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.128299] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.128468] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port c3aa7f96-7b96-4bd4-a567-806f10bb024e not found, creating... [ 622.128730] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.128886] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.128998] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.129235] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.129367] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.129681] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.129803] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.129935] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.130290] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.130433] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.130569] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: c3aa7f96-7b96-4bd4-a567-806f10bb024e is going to be created. [ 622.155148] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.155309] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.155402] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.155630] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.155902] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.156078] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-c3aa7f96-7b96-4bd4-a567-806f10bb024e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.258677] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.258677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.258677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.259270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.259270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.259270] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 already deleted. [ 622.259270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.316312] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10f4ddf0-dcfa-477c-9b2e-29a59bdda051 [ 622.316610] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.316699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.316741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.316962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.317344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.317344] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10f4ddf0-dcfa-477c-9b2e-29a59bdda051 already deleted. [ 622.317344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10f4ddf0-dcfa-477c-9b2e-29a59bdda051" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.337468] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.337468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.337468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.337468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.337468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.337468] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.337468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.337468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.337468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.337468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.337468] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 already deleted. [ 622.337468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.461177] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4086b76a-3e95-4d23-84c4-3a1aea03e049 [ 622.461919] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.461919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.461919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.461919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.462184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.462184] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4086b76a-3e95-4d23-84c4-3a1aea03e049 already deleted. [ 622.462184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4086b76a-3e95-4d23-84c4-3a1aea03e049" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.511920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.512097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.512267] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.512522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.512615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.512717] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 622.547871] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.547871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.548052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.548353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.548353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.557807] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 622.858859] env[66854]: INFO networking_nsxv3.common.synchronization [req-2b485972-a209-46b8-a38e-91f713ad9cf4 req-a93bd2ce-97ea-42ac-a362-c37ae2c6b71d service nova] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_rules [ 622.858859] env[66854]: INFO networking_nsxv3.common.synchronization [req-2b485972-a209-46b8-a38e-91f713ad9cf4 req-a93bd2ce-97ea-42ac-a362-c37ae2c6b71d service nova] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 622.858859] env[66854]: INFO networking_nsxv3.common.synchronization [req-2b485972-a209-46b8-a38e-91f713ad9cf4 req-a93bd2ce-97ea-42ac-a362-c37ae2c6b71d service nova] Enqueued Resource ID: c3aa7f96-7b96-4bd4-a567-806f10bb024e with Priority: HIGHEST for action port [ 622.859174] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_rules [ 622.861377] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 622.861377] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3aa7f96-7b96-4bd4-a567-806f10bb024e with Priority: HIGHEST for action port [ 622.861377] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.861377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.861377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.861377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.861377] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.861377] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.861377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.861377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.862307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.862307] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.862307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.862307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.862307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.862307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.862307] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.864170] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3aa7f96-7b96-4bd4-a567-806f10bb024e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.864170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3aa7f96-7b96-4bd4-a567-806f10bb024e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.864606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3aa7f96-7b96-4bd4-a567-806f10bb024e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.865344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3aa7f96-7b96-4bd4-a567-806f10bb024e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.865427] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3aa7f96-7b96-4bd4-a567-806f10bb024e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.939865] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: SUCCESS [ 622.939865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.155838] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.156074] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.156217] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.156533] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.156786] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.157018] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.157172] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.157453] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.157652] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.157874] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.158027] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.158146] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.158255] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.158366] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.158482] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.158649] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.176853] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.177038] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.177178] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.177352] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.177662] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-1a9052b0-f24c-45da-8565-d9719038222c taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.177827] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-1a9052b0-f24c-45da-8565-d9719038222c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.177954] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-1a9052b0-f24c-45da-8565-d9719038222c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.178387] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-1a9052b0-f24c-45da-8565-d9719038222c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.178526] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a9052b0-f24c-45da-8565-d9719038222c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.367259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.367543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.367633] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.369869] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3aa7f96-7b96-4bd4-a567-806f10bb024e with status ACTIVE [ 623.369869] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.369869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.369869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.369869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.369869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.369869] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.369869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.369869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.370408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.370408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.370408] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.370408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.370408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.370688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.370688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.370688] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3aa7f96-7b96-4bd4-a567-806f10bb024e is going to be updated. [ 623.424622] env[66854]: INFO networking_nsxv3.common.synchronization [req-76448646-3182-4eeb-ba0a-3387cb9b8752 req-8ad9308d-3616-4e39-b8ab-201eab806eda tempest-ImagesOneServerTestJSON-1695644909 tempest-ImagesOneServerTestJSON-1695644909-project-member] Enqueued Resource ID: a491a51f-1883-4e2c-a822-89d817e590ca with Priority: HIGHEST for action security_group_members [ 623.425738] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.425879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.425948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.426254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.426392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.426543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3aa7f96-7b96-4bd4-a567-806f10bb024e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.427030] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a491a51f-1883-4e2c-a822-89d817e590ca with Priority: HIGHEST for action security_group_members [ 623.427320] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a491a51f-1883-4e2c-a822-89d817e590ca taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.427428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.427495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.427712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.427865] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.427960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.428034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.428196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.428285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.428378] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a491a51f-1883-4e2c-a822-89d817e590ca',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.643915] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 623.643915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.643915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.643915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.643915] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.681469] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.681646] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.681765] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.682066] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.682203] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.682347] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 1a9052b0-f24c-45da-8565-d9719038222c not found, creating... [ 623.682834] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.684103] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.684103] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.684103] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.684103] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.684103] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.684287] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.684287] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.684477] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.684602] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.684815] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 1a9052b0-f24c-45da-8565-d9719038222c is going to be created. [ 623.707533] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.707751] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.707869] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.708158] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.708371] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.708936] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-1a9052b0-f24c-45da-8565-d9719038222c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.804239] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.804433] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-36" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.804554] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-36" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.804905] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-36" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.805181] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.805337] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.805573] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.805811] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.806024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.806192] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.806309] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.806486] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.806594] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.806702] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.806816] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.806954] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.832235] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.832404] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.832536] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.832712] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-36" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.833065] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-7767adca-87a6-4a9c-a199-a5c6ccde896c taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.833315] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-7767adca-87a6-4a9c-a199-a5c6ccde896c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.833435] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-7767adca-87a6-4a9c-a199-a5c6ccde896c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.833749] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-7767adca-87a6-4a9c-a199-a5c6ccde896c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.833879] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7767adca-87a6-4a9c-a199-a5c6ccde896c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.874274] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.932282] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.932564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.932676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.932905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.932997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.933215] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.933318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.933394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.933534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.933611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.933758] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a491a51f-1883-4e2c-a822-89d817e590ca already deleted. [ 623.933839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.145699] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.145699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.336614] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.337291] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.337291] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.337291] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.337490] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.337530] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 7767adca-87a6-4a9c-a199-a5c6ccde896c not found, creating... [ 624.337856] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.337968] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.338070] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.338317] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.338443] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.338719] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.338869] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.338981] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.339203] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.339325] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.339463] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 7767adca-87a6-4a9c-a199-a5c6ccde896c is going to be created. [ 624.359925] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.360164] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.360285] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.360554] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.360800] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.361057] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-7767adca-87a6-4a9c-a199-a5c6ccde896c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.376849] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.377200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.377200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.377274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.377366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.377459] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be created. [ 624.406748] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.406954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.407090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.407304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.407465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.415062] env[66854]: INFO networking_nsxv3.common.synchronization [req-2018b42b-6e9f-408e-8d7d-9d4c3ac38372 req-5976a981-d541-4974-ac18-f2719c2ed620 service nova] Enqueued Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_rules [ 624.415189] env[66854]: INFO networking_nsxv3.common.synchronization [req-2018b42b-6e9f-408e-8d7d-9d4c3ac38372 req-5976a981-d541-4974-ac18-f2719c2ed620 service nova] Enqueued Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 624.415417] env[66854]: INFO networking_nsxv3.common.synchronization [req-2018b42b-6e9f-408e-8d7d-9d4c3ac38372 req-5976a981-d541-4974-ac18-f2719c2ed620 service nova] Enqueued Resource ID: 1a9052b0-f24c-45da-8565-d9719038222c with Priority: HIGHEST for action port [ 624.415846] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_rules [ 624.415930] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 624.416020] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a9052b0-f24c-45da-8565-d9719038222c with Priority: HIGHEST for action port [ 624.416734] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.416859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.416928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.417193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.417279] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.419121] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.419250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.419318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.419531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.420080] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.420190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.420268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.421109] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.421248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.421340] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.422822] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a9052b0-f24c-45da-8565-d9719038222c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.422822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a9052b0-f24c-45da-8565-d9719038222c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.422822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a9052b0-f24c-45da-8565-d9719038222c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.422822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a9052b0-f24c-45da-8565-d9719038222c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.422822] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a9052b0-f24c-45da-8565-d9719038222c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.424690] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: UNINITIALIZED for 2s [ 624.569377] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 624.569769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.569906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.570161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.570435] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.570507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.570618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.570904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.571035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.571139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.571242] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.925160] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.925349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.925506] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a9052b0-f24c-45da-8565-d9719038222c with status ACTIVE [ 624.925813] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.925813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.925958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.926122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.926215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.926631] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.926631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.926631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.926781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.926781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.926947] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.927055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.928038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.928038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.928038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.928038] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a9052b0-f24c-45da-8565-d9719038222c is going to be updated. [ 624.929111] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.962685] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.962685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.962685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.962685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.962685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.962685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a9052b0-f24c-45da-8565-d9719038222c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.079774] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.082212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.082212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.082212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.082212] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.082212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.082212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.082212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.082212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.082212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.082212] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.082698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.082698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.082698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.082698] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.082816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.082816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.083471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.083471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.083471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.083471] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.146708] env[66854]: INFO networking_nsxv3.common.synchronization [req-76448646-3182-4eeb-ba0a-3387cb9b8752 req-51c1c58e-9b6e-418e-96ac-229d39bb2682 service nova] Enqueued Resource ID: a491a51f-1883-4e2c-a822-89d817e590ca with Priority: HIGHEST for action security_group_rules [ 625.146902] env[66854]: INFO networking_nsxv3.common.synchronization [req-76448646-3182-4eeb-ba0a-3387cb9b8752 req-51c1c58e-9b6e-418e-96ac-229d39bb2682 service nova] Enqueued Resource ID: a491a51f-1883-4e2c-a822-89d817e590ca with Priority: HIGHEST for action security_group_members [ 625.147335] env[66854]: INFO networking_nsxv3.common.synchronization [req-76448646-3182-4eeb-ba0a-3387cb9b8752 req-51c1c58e-9b6e-418e-96ac-229d39bb2682 service nova] Enqueued Resource ID: 7767adca-87a6-4a9c-a199-a5c6ccde896c with Priority: HIGHEST for action port [ 625.147335] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a491a51f-1883-4e2c-a822-89d817e590ca with Priority: HIGHEST for action security_group_rules [ 625.147419] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a491a51f-1883-4e2c-a822-89d817e590ca with Priority: HIGHEST for action security_group_members [ 625.149472] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767adca-87a6-4a9c-a199-a5c6ccde896c with Priority: HIGHEST for action port [ 625.150214] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a491a51f-1883-4e2c-a822-89d817e590ca taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.150381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.150479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.150915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.150988] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a491a51f-1883-4e2c-a822-89d817e590ca',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.152053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a491a51f-1883-4e2c-a822-89d817e590ca taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.152218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.152317] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.153031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.153031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.153031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.153031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.153217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.153217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.153376] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a491a51f-1883-4e2c-a822-89d817e590ca',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.154193] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-7767adca-87a6-4a9c-a199-a5c6ccde896c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.154327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7767adca-87a6-4a9c-a199-a5c6ccde896c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.154395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7767adca-87a6-4a9c-a199-a5c6ccde896c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.154553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7767adca-87a6-4a9c-a199-a5c6ccde896c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.154623] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7767adca-87a6-4a9c-a199-a5c6ccde896c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.231291] env[66854]: INFO networking_nsxv3.common.synchronization [req-d81ed9a1-ad6e-4f65-822a-8c69ed93097c req-252ee034-9544-4e1d-8c02-093666485ad3 tempest-ServerDiagnosticsTest-1418191994 tempest-ServerDiagnosticsTest-1418191994-project-member] Enqueued Resource ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d with Priority: HIGHEST for action security_group_members [ 625.231291] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d with Priority: HIGHEST for action security_group_members [ 625.231291] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b47b969-b701-468c-8b2e-9e8473ecb61d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.231291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.231291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.231877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.232096] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.232169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.232230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.232393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.232482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.232569] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b47b969-b701-468c-8b2e-9e8473ecb61d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.432525] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.478405] env[66854]: INFO networking_nsxv3.common.synchronization [None req-3b9c1cc0-727b-497f-9f6e-5a6ef34ace8d tempest-ServersTestBootFromVolume-1832221709 tempest-ServersTestBootFromVolume-1832221709-project-member] Enqueued Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_rules [ 625.479659] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_rules [ 625.479978] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82708b01-13e8-453a-8492-93929a99b850 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.480119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.480189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.480454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.480565] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.561239] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.561460] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.561675] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.562015] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.562300] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.562462] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.562593] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.562820] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.562974] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.563204] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.563333] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.563448] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.563556] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.563692] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.563803] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.563954] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.586834] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.587076] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.587239] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.587422] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.587736] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-b3df2343-7d46-4791-9009-7ace70ef73da taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.587970] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-b3df2343-7d46-4791-9009-7ace70ef73da" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.588119] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-b3df2343-7d46-4791-9009-7ace70ef73da" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.588484] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-b3df2343-7d46-4791-9009-7ace70ef73da" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.588636] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3df2343-7d46-4791-9009-7ace70ef73da',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.589677] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1871982-9cf3-4b58-bd63-59badb5546d2: rpc.has_security_group_logging(os_id): False [ 625.610137] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.610288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.610341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.610574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.610681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.610925] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.611668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.611668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.611668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.611668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.611668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.611668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.611934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.611934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.611934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.612196] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.612334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.612417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.613021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.613021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.613021] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 625.616032] env[66854]: INFO networking_nsxv3.common.synchronization [None req-1e34571f-245d-48ad-a9b5-8bc49bc41cac tempest-ServersTestBootFromVolume-1832221709 tempest-ServersTestBootFromVolume-1832221709-project-member] Enqueued Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_rules [ 625.617145] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_rules [ 625.617506] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82708b01-13e8-453a-8492-93929a99b850 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.617606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.656419] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a491a51f-1883-4e2c-a822-89d817e590ca',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.657542] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a491a51f-1883-4e2c-a822-89d817e590ca taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.657680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.658085] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7767adca-87a6-4a9c-a199-a5c6ccde896c with status ACTIVE [ 625.658260] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.658369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.658451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.658653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.658764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.658941] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.659049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.659112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.660231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.660231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.660231] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.660231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.660231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.660231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.660231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.660231] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7767adca-87a6-4a9c-a199-a5c6ccde896c is going to be updated. [ 625.680742] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.681121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.681222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.681457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.681652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.687705] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.687705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.687705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.687705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.688395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.688395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7767adca-87a6-4a9c-a199-a5c6ccde896c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.698216] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 625.736743] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.737506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.737506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.737506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.737506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.738083] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.738083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.738083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.738306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.738306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.738414] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d already deleted. [ 625.738495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.936838] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.936838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.936838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.936838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.936838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.936838] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 is going to be created. [ 625.960414] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.960606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.960606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.961415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.961415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.972819] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: UNINITIALIZED for 2s [ 626.000639] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.000868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.000868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.001078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.001168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.001265] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82708b01-13e8-453a-8492-93929a99b850 already deleted. [ 626.001400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.001628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.001823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.001932] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.092260] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.092481] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.092598] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.092884] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.093045] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.093202] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port b3df2343-7d46-4791-9009-7ace70ef73da not found, creating... [ 626.093451] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.093603] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.093772] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.093992] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.094140] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.094411] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.094561] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.094691] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.094904] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.095044] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.095183] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: b3df2343-7d46-4791-9009-7ace70ef73da is going to be created. [ 626.116849] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.117139] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.117273] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.117543] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.117770] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.117986] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-b3df2343-7d46-4791-9009-7ace70ef73da" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.158592] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a491a51f-1883-4e2c-a822-89d817e590ca',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.446342] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 626.446613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.446739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.446971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.447486] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.447486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.447486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.447649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.447649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.447753] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.447850] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.524887] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.525215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.525308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.525523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.525616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.525716] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82708b01-13e8-453a-8492-93929a99b850 already deleted. [ 626.525800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.661097] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.661268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.661329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.661619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.662019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.662019] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a491a51f-1883-4e2c-a822-89d817e590ca is going to be created. [ 626.686808] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.686975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.687323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.687323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.687769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.697367] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a491a51f-1883-4e2c-a822-89d817e590ca in Status: UNINITIALIZED for 2s [ 626.863475] env[66854]: INFO networking_nsxv3.common.synchronization [req-d81ed9a1-ad6e-4f65-822a-8c69ed93097c req-7c130bff-ad58-4dec-81ba-0200a68eb5a0 service nova] Enqueued Resource ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d with Priority: HIGHEST for action security_group_rules [ 626.866397] env[66854]: INFO networking_nsxv3.common.synchronization [req-d81ed9a1-ad6e-4f65-822a-8c69ed93097c req-7c130bff-ad58-4dec-81ba-0200a68eb5a0 service nova] Enqueued Resource ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d with Priority: HIGHEST for action security_group_members [ 626.866397] env[66854]: INFO networking_nsxv3.common.synchronization [req-d81ed9a1-ad6e-4f65-822a-8c69ed93097c req-7c130bff-ad58-4dec-81ba-0200a68eb5a0 service nova] Enqueued Resource ID: b3df2343-7d46-4791-9009-7ace70ef73da with Priority: HIGHEST for action port [ 626.866397] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d with Priority: HIGHEST for action security_group_rules [ 626.866397] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d with Priority: HIGHEST for action security_group_members [ 626.866397] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3df2343-7d46-4791-9009-7ace70ef73da with Priority: HIGHEST for action port [ 626.866397] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b47b969-b701-468c-8b2e-9e8473ecb61d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.866397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.866397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.866397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.866397] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b47b969-b701-468c-8b2e-9e8473ecb61d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.867107] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b47b969-b701-468c-8b2e-9e8473ecb61d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.867107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.867107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.867107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.867466] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.867901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.868032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.868202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.868293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.868389] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b47b969-b701-468c-8b2e-9e8473ecb61d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.869934] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3df2343-7d46-4791-9009-7ace70ef73da taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.869934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3df2343-7d46-4791-9009-7ace70ef73da" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.869934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3df2343-7d46-4791-9009-7ace70ef73da" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.869934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3df2343-7d46-4791-9009-7ace70ef73da" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.869934] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3df2343-7d46-4791-9009-7ace70ef73da',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.949827] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.951439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.951439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.951439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.951439] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.951439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.951439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.951439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.951439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.951439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.951439] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.951854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.951854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.952135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.952599] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.952751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.952854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.953067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.953192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.953348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.953529] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.371861] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b47b969-b701-468c-8b2e-9e8473ecb61d taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.373865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.373865] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b47b969-b701-468c-8b2e-9e8473ecb61d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.373865] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3df2343-7d46-4791-9009-7ace70ef73da with status ACTIVE [ 627.373865] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.377021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.377021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.377816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.377816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.377816] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.377816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.377816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.377816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.377816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.379386] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.379386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.379386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.379386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.379386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.379386] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3df2343-7d46-4791-9009-7ace70ef73da is going to be updated. [ 627.406952] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.407886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.407988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.408225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.408557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.408557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3df2343-7d46-4791-9009-7ace70ef73da" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.457021] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ccc5a4-8c8a-445b-b37a-462c691c3639: rpc.has_security_group_logging(os_id): False [ 627.501978] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.502214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.502311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.502634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.502782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.503094] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.503255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.503358] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.505234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.505285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.505541] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.505829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.505919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.506137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.506257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.506516] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.506648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.506735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.506910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.507036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.507144] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be created. [ 627.607038] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.607038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.607038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.607038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.607038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.618973] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 627.672863] env[66854]: INFO networking_nsxv3.common.synchronization [req-74499d92-0334-4bc7-b362-c088610c16b1 req-a6a6e37c-4f0e-4e35-98c3-a054922fc39c tempest-ServerExternalEventsTest-1149133109 tempest-ServerExternalEventsTest-1149133109-project-member] Enqueued Resource ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 with Priority: HIGHEST for action security_group_members [ 627.672863] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 with Priority: HIGHEST for action security_group_members [ 627.672863] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-480a784d-e1e2-4919-8cb1-9c77138c1be4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.672863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.673420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.673904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.674240] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.674537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.674696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.674961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.675187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.675626] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480a784d-e1e2-4919-8cb1-9c77138c1be4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.717257] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 627.717470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.881370] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b47b969-b701-468c-8b2e-9e8473ecb61d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.985440] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: SUCCESS [ 627.985657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.985848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.986137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.986347] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.986457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.986517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.986694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.986795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.986959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.987037] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.123237] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.123457] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.123597] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.123929] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.124234] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.124420] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.124542] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.124787] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.124975] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.125222] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.125377] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.125427] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.125551] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.125704] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.125883] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.126101] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.149137] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.149190] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.149359] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.149477] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.149788] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-75187137-ec6c-4f43-a657-521add7396f0 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.150260] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-75187137-ec6c-4f43-a657-521add7396f0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.150807] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-75187137-ec6c-4f43-a657-521add7396f0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.151257] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-75187137-ec6c-4f43-a657-521add7396f0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.151570] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75187137-ec6c-4f43-a657-521add7396f0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.180288] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.180585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.180734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.181087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.181253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.182345] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.182345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.182345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.182345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.182554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.182554] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 already deleted. [ 628.182702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.384122] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.384283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.384354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.384571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.384894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.384894] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d is going to be created. [ 628.412505] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.412505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.412505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.412820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.412996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.422940] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d in Status: UNINITIALIZED for 2s [ 628.489737] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.490070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.490070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.490213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.491030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.491030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.491030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.491030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.491030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.491030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.491030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.491352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.491352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.491352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.491459] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.491499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.491626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.491802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.491881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.491964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.492072] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.654441] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.654756] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.654831] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.655096] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.655244] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.655395] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 75187137-ec6c-4f43-a657-521add7396f0 not found, creating... [ 628.655672] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.655801] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.655911] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.656178] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.656312] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.656586] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.656747] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.656862] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.657078] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.657210] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.657344] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 75187137-ec6c-4f43-a657-521add7396f0 is going to be created. [ 628.678089] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.678293] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.678416] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.678675] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.678920] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.679150] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-75187137-ec6c-4f43-a657-521add7396f0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.708235] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a491a51f-1883-4e2c-a822-89d817e590ca in Status: SUCCESS [ 628.708445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.708593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.708808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.708999] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.709168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.709225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.709341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.709420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.709502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.709591] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a491a51f-1883-4e2c-a822-89d817e590ca',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.996464] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882c622e-5e75-4cbc-a5f9-518be75e1bd0: rpc.has_security_group_logging(os_id): False [ 629.016446] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.016602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.016673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.016901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.016993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.017198] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.017304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.017421] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.017511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.017599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.017783] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.017879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.017941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.018503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.018503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.018503] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.018503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.018503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.018802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.018802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.018802] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 is going to be created. [ 629.094267] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.094594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.094594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.094842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.095137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.107837] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: IN_PROGRESS for 2s [ 629.212225] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a491a51f-1883-4e2c-a822-89d817e590ca taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.212552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.213531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.213531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.213773] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.213947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.214057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.214351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.214412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.214763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.214763] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a491a51f-1883-4e2c-a822-89d817e590ca taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.214900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.215971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.215971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.215971] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.215971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.215971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.215971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.215971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.215971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.215971] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a491a51f-1883-4e2c-a822-89d817e590ca',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.406265] env[66854]: INFO networking_nsxv3.common.synchronization [req-74499d92-0334-4bc7-b362-c088610c16b1 req-638bd019-803d-4c39-978f-b955559f6551 service nova] Enqueued Resource ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 with Priority: HIGHEST for action security_group_rules [ 629.406505] env[66854]: INFO networking_nsxv3.common.synchronization [req-74499d92-0334-4bc7-b362-c088610c16b1 req-638bd019-803d-4c39-978f-b955559f6551 service nova] Enqueued Resource ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 with Priority: HIGHEST for action security_group_members [ 629.406723] env[66854]: INFO networking_nsxv3.common.synchronization [req-74499d92-0334-4bc7-b362-c088610c16b1 req-638bd019-803d-4c39-978f-b955559f6551 service nova] Enqueued Resource ID: 75187137-ec6c-4f43-a657-521add7396f0 with Priority: HIGHEST for action port [ 629.407343] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 with Priority: HIGHEST for action security_group_rules [ 629.407710] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 with Priority: HIGHEST for action security_group_members [ 629.407831] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75187137-ec6c-4f43-a657-521add7396f0 with Priority: HIGHEST for action port [ 629.408139] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-480a784d-e1e2-4919-8cb1-9c77138c1be4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.408288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.408398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.408683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.408771] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('480a784d-e1e2-4919-8cb1-9c77138c1be4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.411563] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-480a784d-e1e2-4919-8cb1-9c77138c1be4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.411706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.411805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.412359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.412544] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.412652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.412719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.412894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.412977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.413100] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480a784d-e1e2-4919-8cb1-9c77138c1be4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.414680] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-75187137-ec6c-4f43-a657-521add7396f0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.414680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75187137-ec6c-4f43-a657-521add7396f0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.414680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75187137-ec6c-4f43-a657-521add7396f0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.414680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75187137-ec6c-4f43-a657-521add7396f0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.414680] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75187137-ec6c-4f43-a657-521add7396f0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.496515] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e98a75a9-70d0-4803-9ccd-7eedabc9ba0e None None] Enqueued Resource ID: ca661eb5-69d2-40f8-b38f-5893f7a1ca9a with Priority: HIGHEST for action port [ 629.496908] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca661eb5-69d2-40f8-b38f-5893f7a1ca9a with Priority: HIGHEST for action port [ 629.496994] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca661eb5-69d2-40f8-b38f-5893f7a1ca9a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.497125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca661eb5-69d2-40f8-b38f-5893f7a1ca9a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.497188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca661eb5-69d2-40f8-b38f-5893f7a1ca9a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.497515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca661eb5-69d2-40f8-b38f-5893f7a1ca9a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.497597] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca661eb5-69d2-40f8-b38f-5893f7a1ca9a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.633887] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 629.634104] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.719704] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a491a51f-1883-4e2c-a822-89d817e590ca: rpc.has_security_group_logging(os_id): False [ 629.741079] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.741182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.741221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.741451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.741564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.741891] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.741980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.742050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.742210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.742292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.742485] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.742591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.742649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.742798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.742875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.743081] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.743183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.743349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.743512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.743593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.743735] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a491a51f-1883-4e2c-a822-89d817e590ca is going to be created. [ 629.810867] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.811079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.811141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.811368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.812463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.826398] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a491a51f-1883-4e2c-a822-89d817e590ca in Status: IN_PROGRESS for 2s [ 629.915974] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('480a784d-e1e2-4919-8cb1-9c77138c1be4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.917165] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-480a784d-e1e2-4919-8cb1-9c77138c1be4 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.917299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.918814] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75187137-ec6c-4f43-a657-521add7396f0 with status ACTIVE [ 629.919042] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.919156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.919244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.919438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.919526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.919713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.919830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.919922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.920040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.920135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.920744] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.920744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.920744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.920744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.920744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.920744] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75187137-ec6c-4f43-a657-521add7396f0 is going to be updated. [ 629.944788] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.944978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.945070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.945300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.945435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.945596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75187137-ec6c-4f43-a657-521add7396f0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.999788] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca661eb5-69d2-40f8-b38f-5893f7a1ca9a [ 630.000512] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.000667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.000741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.000954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.001123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.001186] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca661eb5-69d2-40f8-b38f-5893f7a1ca9a already deleted. [ 630.001254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca661eb5-69d2-40f8-b38f-5893f7a1ca9a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.369158] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-eb8c1233-83f0-4903-8dfa-54e5b0960026 tempest-ServersTestMultiNic-36060217 tempest-ServersTestMultiNic-36060217-project-member] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 630.370408] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 630.372037] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.372037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.372037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.372037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.372037] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.372037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.372037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.372673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.372673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.372673] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.418304] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('480a784d-e1e2-4919-8cb1-9c77138c1be4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.433484] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d in Status: SUCCESS [ 630.434091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.434091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.434279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.434401] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.434524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.434595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.434832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.434920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.435022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.435114] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b47b969-b701-468c-8b2e-9e8473ecb61d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.787202] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-5ab93f8c-bb49-4fd3-95a4-bebc1e157a8e tempest-ServersTestMultiNic-36060217 tempest-ServersTestMultiNic-36060217-project-member] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 630.791681] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 630.791681] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.791681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.874535] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.874754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.874754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.875029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.875478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.875698] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.875843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.875896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.876243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.876444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.876539] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a already deleted. [ 630.876624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.876808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.877026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.879211] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.879625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.879706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.879885] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.879970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.880094] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.920973] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.922041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.922041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.922279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.923924] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.923924] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 is going to be created. [ 630.938279] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b47b969-b701-468c-8b2e-9e8473ecb61d taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.938489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.938535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.938769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.938966] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.939089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.939136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.939312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.939399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.939491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.939657] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b47b969-b701-468c-8b2e-9e8473ecb61d taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.939771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.939884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.939967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.940136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.940229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.940290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.940440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.940519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.940601] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.940710] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b47b969-b701-468c-8b2e-9e8473ecb61d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.955716] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.956089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.956208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.956562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.956741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.969723] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 in Status: UNINITIALIZED for 2s [ 631.126420] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: SUCCESS [ 631.126690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.327566] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-7be62f0c-b4ec-4779-858d-71dde58304b5 tempest-ServersTestMultiNic-36060217 tempest-ServersTestMultiNic-36060217-project-member] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 631.331958] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 631.331958] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.332193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.383256] env[66854]: INFO networking_nsxv3.common.synchronization [None req-141823fe-c45a-477f-baad-d9830518917d None None] Enqueued Resource ID: 40e21152-91fa-4f6c-9769-c262082b24e2 with Priority: HIGHEST for action port [ 631.384400] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40e21152-91fa-4f6c-9769-c262082b24e2 with Priority: HIGHEST for action port [ 631.385208] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.385923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.385923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.385923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.385923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.385923] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.386133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.386133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.386271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.386328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.386414] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a already deleted. [ 631.386496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.386776] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-40e21152-91fa-4f6c-9769-c262082b24e2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.386896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40e21152-91fa-4f6c-9769-c262082b24e2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.386896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40e21152-91fa-4f6c-9769-c262082b24e2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.387096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40e21152-91fa-4f6c-9769-c262082b24e2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.387177] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40e21152-91fa-4f6c-9769-c262082b24e2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.391951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.391951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.391951] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.391951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.391951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.392161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.393899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.393899] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.444857] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b47b969-b701-468c-8b2e-9e8473ecb61d: rpc.has_security_group_logging(os_id): False [ 631.468322] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.468515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.468577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.468849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.469010] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.469245] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.469853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.469853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.469853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.469853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.471136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.471136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.471136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.471136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.471136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.471136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.471136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.471368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.471368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.471424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.471575] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d is going to be created. [ 631.556254] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.556587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.556587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.556804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.557392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.573431] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d in Status: IN_PROGRESS for 2s [ 631.725758] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.725758] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-987" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.725758] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-987" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.725758] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-987" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.726422] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.726804] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.727098] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.727492] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.727779] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.730016] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.730016] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.730016] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.730016] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.730016] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.730016] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.730016] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.750870] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.751042] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.751106] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.751311] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-987" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.751767] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-93653b7d-0f58-4fa9-aa7d-dcbd68dcec02 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.751991] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-93653b7d-0f58-4fa9-aa7d-dcbd68dcec02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.752151] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-93653b7d-0f58-4fa9-aa7d-dcbd68dcec02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.752510] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-93653b7d-0f58-4fa9-aa7d-dcbd68dcec02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.752675] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93653b7d-0f58-4fa9-aa7d-dcbd68dcec02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.840674] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a491a51f-1883-4e2c-a822-89d817e590ca in Status: SUCCESS [ 631.840674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.893990] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40e21152-91fa-4f6c-9769-c262082b24e2 [ 631.894291] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.894794] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.894794] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.895060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.895158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.895321] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40e21152-91fa-4f6c-9769-c262082b24e2 already deleted. [ 631.895407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40e21152-91fa-4f6c-9769-c262082b24e2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.895752] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.896052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.896052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.896164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.896557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.896557] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.896557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.896557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.897032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.897032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.897032] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a already deleted. [ 631.897032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.257990] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.257990] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.257990] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.257990] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.258351] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.258351] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 93653b7d-0f58-4fa9-aa7d-dcbd68dcec02 not found, creating... [ 632.258485] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.258651] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.258776] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.259060] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.259202] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.259509] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.259665] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.259780] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.259996] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.260150] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.260374] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 93653b7d-0f58-4fa9-aa7d-dcbd68dcec02 is going to be created. [ 632.284019] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.284345] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.284478] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.284808] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.284991] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.285238] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-93653b7d-0f58-4fa9-aa7d-dcbd68dcec02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.982783] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 in Status: SUCCESS [ 632.983237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.983237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.983447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.983645] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.983791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.983866] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.984040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.984123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.984222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.984311] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('480a784d-e1e2-4919-8cb1-9c77138c1be4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.067559] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-c0a6caeb-a489-470d-84bd-984621663f19 service nova] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_rules [ 633.067739] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-c0a6caeb-a489-470d-84bd-984621663f19 service nova] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 633.067895] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-c0a6caeb-a489-470d-84bd-984621663f19 service nova] Enqueued Resource ID: 93653b7d-0f58-4fa9-aa7d-dcbd68dcec02 with Priority: HIGHEST for action port [ 633.068407] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_rules [ 633.068559] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 633.068661] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93653b7d-0f58-4fa9-aa7d-dcbd68dcec02 with Priority: HIGHEST for action port [ 633.068940] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.069287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.069363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.069658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.069798] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.071583] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.071718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.072077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.072325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.072598] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.072781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.072946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.073137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.073258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.073327] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.074452] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-93653b7d-0f58-4fa9-aa7d-dcbd68dcec02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.074665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93653b7d-0f58-4fa9-aa7d-dcbd68dcec02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.074665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93653b7d-0f58-4fa9-aa7d-dcbd68dcec02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.075595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93653b7d-0f58-4fa9-aa7d-dcbd68dcec02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.075772] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93653b7d-0f58-4fa9-aa7d-dcbd68dcec02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.486323] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-480a784d-e1e2-4919-8cb1-9c77138c1be4 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.486467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.486467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.486863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.486863] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.487086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.487086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.487215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.487294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.487393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.487557] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-480a784d-e1e2-4919-8cb1-9c77138c1be4 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.487755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.487755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.487957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.487957] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.488213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.488213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.488513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.488513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.488513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.488513] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('480a784d-e1e2-4919-8cb1-9c77138c1be4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.581029] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.581029] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.581029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.581029] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93653b7d-0f58-4fa9-aa7d-dcbd68dcec02 with status ACTIVE [ 633.581029] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.581029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.581029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.581029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.581029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.581029] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.581029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.581029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.581029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.581029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.581657] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.581657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.581657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.581657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.582837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.583485] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93653b7d-0f58-4fa9-aa7d-dcbd68dcec02 is going to be updated. [ 633.590413] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d in Status: SUCCESS [ 633.590638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.612141] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.612772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.612772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.612772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.612772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.613431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93653b7d-0f58-4fa9-aa7d-dcbd68dcec02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.975941] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-412 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.975941] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-412" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.975941] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-412" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.976299] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-412" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.976453] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.976608] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.976763] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.977029] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.977127] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.977326] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.977440] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.977590] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.977690] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.977795] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.977894] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.978114] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.001037] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 480a784d-e1e2-4919-8cb1-9c77138c1be4: rpc.has_security_group_logging(os_id): False [ 634.002267] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.002528] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.002589] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.002867] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-412" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.003239] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-189682c5-edf9-4e1a-9d02-f1a61fb56e70 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.004725] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-189682c5-edf9-4e1a-9d02-f1a61fb56e70" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.004725] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-189682c5-edf9-4e1a-9d02-f1a61fb56e70" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.004725] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-189682c5-edf9-4e1a-9d02-f1a61fb56e70" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.004725] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('189682c5-edf9-4e1a-9d02-f1a61fb56e70',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.022543] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.022740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.022937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.023231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.023309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.023548] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.023703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.024105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.024105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.024105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.024448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.024448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.024448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.025463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.025463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.025463] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.025827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.025827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.025902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.025932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.026492] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 is going to be created. [ 634.087717] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.099154] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.100122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.100563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.100663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.101125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.121118] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 in Status: IN_PROGRESS for 2s [ 634.245352] env[66854]: INFO networking_nsxv3.common.synchronization [None req-c0fa2abd-ff59-4dea-8fe7-db22a39f9d8b tempest-ServersV294TestFqdnHostnames-1797053889 tempest-ServersV294TestFqdnHostnames-1797053889-project-member] Enqueued Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_rules [ 634.245352] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_rules [ 634.245668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.245799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.245862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.246154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.246285] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.508226] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.508478] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.508635] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.509112] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.509191] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.509319] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 189682c5-edf9-4e1a-9d02-f1a61fb56e70 not found, creating... [ 634.509756] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.509858] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.510062] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.510237] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.510400] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.510728] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.510894] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.511014] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.511260] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.511432] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.512083] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 189682c5-edf9-4e1a-9d02-f1a61fb56e70 is going to be created. [ 634.541610] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.541858] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.542039] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.542308] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.542532] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.542753] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-189682c5-edf9-4e1a-9d02-f1a61fb56e70" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.589503] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.589678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.589743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.589961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.590067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.590168] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be created. [ 634.630948] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.631091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.631174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.631402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.631766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.644997] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: UNINITIALIZED for 2s [ 634.727974] env[66854]: INFO networking_nsxv3.common.synchronization [None req-89ddf58c-236c-4e56-aa11-b54ae8734511 tempest-ServersV294TestFqdnHostnames-1797053889 tempest-ServersV294TestFqdnHostnames-1797053889-project-member] Enqueued Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_rules [ 634.728793] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_rules [ 634.729371] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.729487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.774889] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.775174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.775174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.775359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.775576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.775576] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa already deleted. [ 634.775735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.775871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.776124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.776292] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.247679] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-81e01099-2d71-4a1b-bfbe-b1d5c47537b6 service nova] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_rules [ 635.247910] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-81e01099-2d71-4a1b-bfbe-b1d5c47537b6 service nova] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 635.248034] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-81e01099-2d71-4a1b-bfbe-b1d5c47537b6 service nova] Enqueued Resource ID: 189682c5-edf9-4e1a-9d02-f1a61fb56e70 with Priority: HIGHEST for action port [ 635.248562] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_rules [ 635.248692] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 635.248790] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 189682c5-edf9-4e1a-9d02-f1a61fb56e70 with Priority: HIGHEST for action port [ 635.249806] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.250010] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.250367] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.250534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.250994] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-189682c5-edf9-4e1a-9d02-f1a61fb56e70 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.250994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-189682c5-edf9-4e1a-9d02-f1a61fb56e70" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.250994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-189682c5-edf9-4e1a-9d02-f1a61fb56e70" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.251270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-189682c5-edf9-4e1a-9d02-f1a61fb56e70" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.251413] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('189682c5-edf9-4e1a-9d02-f1a61fb56e70',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.297853] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.298083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.298083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.298446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.298446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.298605] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa already deleted. [ 635.298605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.635089] env[66854]: INFO networking_nsxv3.common.synchronization [req-d7ba2cfc-cdcc-4f81-9078-cba97e298ad2 req-37e28231-2551-4bff-a0fd-5b01c6049dd8 tempest-VolumesAssistedSnapshotsTest-1107862057 tempest-VolumesAssistedSnapshotsTest-1107862057-project-member] Enqueued Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_members [ 635.635660] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_members [ 635.635958] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-004af225-cfe6-418e-bf9b-b21fc4fcd911 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.636292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.636367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.636639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.636815] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.636934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.636998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.637176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.637263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.637557] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.754508] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 189682c5-edf9-4e1a-9d02-f1a61fb56e70 with status ACTIVE [ 635.754842] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.754994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.755085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.755312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.755444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.755802] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.755878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.755954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.756205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.756333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.756627] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.756786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.756900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.757143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.757232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.757325] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 189682c5-edf9-4e1a-9d02-f1a61fb56e70 is going to be updated. [ 635.789540] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.789733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.789834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.790184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.790876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.791147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-189682c5-edf9-4e1a-9d02-f1a61fb56e70" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.002781] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.003016] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-595" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.003136] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-595" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.003463] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-595" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.003879] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.004137] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.004261] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.004491] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.004731] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.004978] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.005124] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.005234] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.005339] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.005447] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.005550] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.005698] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.027048] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.027303] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.027462] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.027660] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-595" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.028082] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-28fe95af-ffe0-43e2-936b-1e245f6f24ea taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.028266] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-28fe95af-ffe0-43e2-936b-1e245f6f24ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.028382] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-28fe95af-ffe0-43e2-936b-1e245f6f24ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.028707] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-28fe95af-ffe0-43e2-936b-1e245f6f24ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.028879] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28fe95af-ffe0-43e2-936b-1e245f6f24ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.136433] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 in Status: SUCCESS [ 636.136953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.139833] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.140027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.140111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.140307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.140396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.140616] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.141338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.141338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.141338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.141338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.141338] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 already deleted. [ 636.141338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.159369] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.159763] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-987" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.159961] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-987" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.160429] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-987" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.160966] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.161249] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.161469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.161831] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.162082] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.162444] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.162687] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.162847] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.163064] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.163273] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.163470] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.163729] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.190025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.190312] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.190427] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.190680] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-987" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.191082] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-af1f3f4d-d159-4719-8e87-22e702cb0800 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.191335] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-af1f3f4d-d159-4719-8e87-22e702cb0800" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.191534] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-af1f3f4d-d159-4719-8e87-22e702cb0800" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.191988] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-af1f3f4d-d159-4719-8e87-22e702cb0800" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.192143] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af1f3f4d-d159-4719-8e87-22e702cb0800',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.533405] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.533828] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.534577] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.534577] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.534577] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.534765] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 28fe95af-ffe0-43e2-936b-1e245f6f24ea not found, creating... [ 636.535398] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.535398] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.535398] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.535561] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.535561] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.535903] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.536097] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.536215] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.536497] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.536711] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.536902] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 28fe95af-ffe0-43e2-936b-1e245f6f24ea is going to be created. [ 636.561792] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.562039] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.562175] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.562459] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.562860] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.563264] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-28fe95af-ffe0-43e2-936b-1e245f6f24ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.666214] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 636.666447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.667028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.667252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.667452] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.667571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.667638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.667794] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.667875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.667990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.668092] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.669010] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.669190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.669361] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.669466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.669529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.669671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.669753] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.669842] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.695525] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.695996] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.696193] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.696459] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.696620] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.696797] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port af1f3f4d-d159-4719-8e87-22e702cb0800 not found, creating... [ 636.697117] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.697287] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.697405] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.697763] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.697890] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.698241] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.698432] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.698549] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.698798] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.698935] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.699100] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: af1f3f4d-d159-4719-8e87-22e702cb0800 is going to be created. [ 636.739875] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.740379] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.740658] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.741092] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.741399] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.741954] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-af1f3f4d-d159-4719-8e87-22e702cb0800" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.174485] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.174748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.174915] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.284235] env[66854]: INFO networking_nsxv3.common.synchronization [req-d7ba2cfc-cdcc-4f81-9078-cba97e298ad2 req-3bfb50a5-cc5f-4e8e-a4a2-011d2184bfd5 service nova] Enqueued Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_rules [ 637.284460] env[66854]: INFO networking_nsxv3.common.synchronization [req-d7ba2cfc-cdcc-4f81-9078-cba97e298ad2 req-3bfb50a5-cc5f-4e8e-a4a2-011d2184bfd5 service nova] Enqueued Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_members [ 637.284714] env[66854]: INFO networking_nsxv3.common.synchronization [req-d7ba2cfc-cdcc-4f81-9078-cba97e298ad2 req-3bfb50a5-cc5f-4e8e-a4a2-011d2184bfd5 service nova] Enqueued Resource ID: 28fe95af-ffe0-43e2-936b-1e245f6f24ea with Priority: HIGHEST for action port [ 637.285271] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_rules [ 637.285627] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_members [ 637.285805] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28fe95af-ffe0-43e2-936b-1e245f6f24ea with Priority: HIGHEST for action port [ 637.286068] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-004af225-cfe6-418e-bf9b-b21fc4fcd911 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.286192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.286260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.286482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.286616] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.287458] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-004af225-cfe6-418e-bf9b-b21fc4fcd911 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.287575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.287646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.287911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.288249] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.288249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.288395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.288458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.288547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.288813] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.289482] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-28fe95af-ffe0-43e2-936b-1e245f6f24ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.289606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28fe95af-ffe0-43e2-936b-1e245f6f24ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.289683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28fe95af-ffe0-43e2-936b-1e245f6f24ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.289836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28fe95af-ffe0-43e2-936b-1e245f6f24ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.289906] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28fe95af-ffe0-43e2-936b-1e245f6f24ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.446556] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-70c12682-4687-473f-9df3-1e69f7d7b550 service nova] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_rules [ 637.446738] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-70c12682-4687-473f-9df3-1e69f7d7b550 service nova] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 637.446923] env[66854]: INFO networking_nsxv3.common.synchronization [req-d80c14ed-da0a-4c0a-a831-2055830a2d98 req-70c12682-4687-473f-9df3-1e69f7d7b550 service nova] Enqueued Resource ID: af1f3f4d-d159-4719-8e87-22e702cb0800 with Priority: HIGHEST for action port [ 637.447484] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_rules [ 637.447624] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 637.447739] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1f3f4d-d159-4719-8e87-22e702cb0800 with Priority: HIGHEST for action port [ 637.449279] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.449476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.449801] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.449855] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.450052] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-af1f3f4d-d159-4719-8e87-22e702cb0800 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.450174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af1f3f4d-d159-4719-8e87-22e702cb0800" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.450244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af1f3f4d-d159-4719-8e87-22e702cb0800" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.450815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af1f3f4d-d159-4719-8e87-22e702cb0800" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.450901] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af1f3f4d-d159-4719-8e87-22e702cb0800',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.678687] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.791912] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.793034] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-004af225-cfe6-418e-bf9b-b21fc4fcd911 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.794269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.794269] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28fe95af-ffe0-43e2-936b-1e245f6f24ea with status ACTIVE [ 637.794269] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.794269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.794269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.794269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.794789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.794789] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.794789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.794789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.795207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.795207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.799853] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.799853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.799853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.799853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.799853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.799853] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28fe95af-ffe0-43e2-936b-1e245f6f24ea is going to be updated. [ 637.830595] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.830811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.830897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.831152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.831297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.831468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28fe95af-ffe0-43e2-936b-1e245f6f24ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.955856] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af1f3f4d-d159-4719-8e87-22e702cb0800 with status ACTIVE [ 637.956618] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.956858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.956919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.958553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.958742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.959221] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.959316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.959473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.959590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.959730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.960035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.960162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.960253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.961379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.961379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.961379] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af1f3f4d-d159-4719-8e87-22e702cb0800 is going to be updated. [ 637.997999] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.998211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.998305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.998572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.998750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.998974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af1f3f4d-d159-4719-8e87-22e702cb0800" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.182806] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.182806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.182806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.183098] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.183209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.184423] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 638.228433] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.228587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.228635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.228848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.229095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.240786] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 638.294566] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.705121] env[66854]: INFO networking_nsxv3.common.synchronization [req-6212232f-5e99-44aa-b2de-8ed2a55a0b82 req-2adf9250-7cda-48e9-a579-755d1a1eb224 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 638.705121] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 638.705437] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.705437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.705437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.705594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.705753] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.705853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.705925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.706125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.706228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.706327] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.797562] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.797712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.797791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.798042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.798153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.798241] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 is going to be created. [ 638.828758] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.828981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.829046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.829234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.829397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.840383] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 in Status: UNINITIALIZED for 2s [ 639.209045] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.209217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.209327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.209555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.209651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.209828] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.209927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.210039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.210139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.210213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.210299] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 already deleted. [ 639.210372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.211358] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-312 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.211530] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-312" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.211625] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-312" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.211897] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-312" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.212226] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.214133] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.214133] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.214133] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.214133] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.214133] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.214133] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.214133] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.214133] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.214133] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.214133] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.214133] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.236991] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.238157] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.238157] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.238157] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-312" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.238157] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-8475678a-6dc0-420e-8764-60089d7359b9 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.238157] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.238157] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.238466] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.238523] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8475678a-6dc0-420e-8764-60089d7359b9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.740804] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.741038] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.741038] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.741380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.741619] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.741929] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 8475678a-6dc0-420e-8764-60089d7359b9 not found, creating... [ 639.742317] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.742568] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.742761] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.743041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.743864] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.744141] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.744441] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.744642] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.744890] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.745177] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.745403] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 8475678a-6dc0-420e-8764-60089d7359b9 is going to be created. [ 639.766764] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.767021] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.768540] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.768540] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.768540] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.768540] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.254326] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 4s [ 640.479146] env[66854]: INFO networking_nsxv3.common.synchronization [req-6212232f-5e99-44aa-b2de-8ed2a55a0b82 req-bfdfc23d-fbbb-4060-a6f3-dfb002b53113 service nova] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 640.479395] env[66854]: INFO networking_nsxv3.common.synchronization [req-6212232f-5e99-44aa-b2de-8ed2a55a0b82 req-bfdfc23d-fbbb-4060-a6f3-dfb002b53113 service nova] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 640.479530] env[66854]: INFO networking_nsxv3.common.synchronization [req-6212232f-5e99-44aa-b2de-8ed2a55a0b82 req-bfdfc23d-fbbb-4060-a6f3-dfb002b53113 service nova] Enqueued Resource ID: 8475678a-6dc0-420e-8764-60089d7359b9 with Priority: HIGHEST for action port [ 640.480697] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 640.480999] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 640.481188] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8475678a-6dc0-420e-8764-60089d7359b9 with Priority: HIGHEST for action port [ 640.481777] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.481960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.482170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.482726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.482899] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.484305] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.484490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.484656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.484973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.485497] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.485796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.485945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.487345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.487345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.487345] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.488365] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8475678a-6dc0-420e-8764-60089d7359b9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.488603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.488929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.489240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.489423] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8475678a-6dc0-420e-8764-60089d7359b9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.850597] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 in Status: SUCCESS [ 640.850889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.851089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.851326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.851743] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.851743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.851842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.852225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.852225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.852225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.852446] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.989637] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.994465] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.994465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.994465] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8475678a-6dc0-420e-8764-60089d7359b9 with status ACTIVE [ 640.994465] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.994465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.994465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.994465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.994465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.994465] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.994465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.994465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.994465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.994465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.994465] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.995254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.995254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.995254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.995254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.995254] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8475678a-6dc0-420e-8764-60089d7359b9 is going to be updated. [ 641.016771] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.016771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.016968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.017028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.017169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.017334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.354787] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.491430] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.857105] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 004af225-cfe6-418e-bf9b-b21fc4fcd911: rpc.has_security_group_logging(os_id): False [ 641.885553] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.885729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.885822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.886060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.886157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.886408] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.886512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.886579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.886743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.886824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.886933] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 is going to be created. [ 641.965058] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.965058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.965058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.965058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.965058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.983875] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 in Status: IN_PROGRESS for 2s [ 641.995861] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.995861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.995861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.996749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.996749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.996749] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be created. [ 642.009256] env[66854]: INFO networking_nsxv3.common.synchronization [None req-3f056cf5-d5e5-4855-a554-69ece1fcc305 None None] Enqueued Resource ID: 047dd7a9-14b6-4259-b6ee-fbd8eeaa1ec6 with Priority: HIGHEST for action port [ 642.009256] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 047dd7a9-14b6-4259-b6ee-fbd8eeaa1ec6 with Priority: HIGHEST for action port [ 642.009822] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-047dd7a9-14b6-4259-b6ee-fbd8eeaa1ec6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.010204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-047dd7a9-14b6-4259-b6ee-fbd8eeaa1ec6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.010403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-047dd7a9-14b6-4259-b6ee-fbd8eeaa1ec6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.010743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-047dd7a9-14b6-4259-b6ee-fbd8eeaa1ec6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.011036] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('047dd7a9-14b6-4259-b6ee-fbd8eeaa1ec6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.024024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.024024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.024024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.024024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.024024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.041850] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: UNINITIALIZED for 2s [ 642.053900] env[66854]: INFO networking_nsxv3.common.synchronization [None req-d06f8059-ffd9-4ab3-bb25-c2ccddfea738 None None] Enqueued Resource ID: 285a9723-fddf-4aa3-b174-fd5893dd0bb9 with Priority: HIGHEST for action port [ 642.054061] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285a9723-fddf-4aa3-b174-fd5893dd0bb9 with Priority: HIGHEST for action port [ 642.055186] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-285a9723-fddf-4aa3-b174-fd5893dd0bb9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.055335] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-285a9723-fddf-4aa3-b174-fd5893dd0bb9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.055387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-285a9723-fddf-4aa3-b174-fd5893dd0bb9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.056334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-285a9723-fddf-4aa3-b174-fd5893dd0bb9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.056334] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('285a9723-fddf-4aa3-b174-fd5893dd0bb9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.268376] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 642.268694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.269046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.269343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.269704] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.269911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.269911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.270103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.270209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.270322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.270652] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.270769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.270960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.271170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.271415] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.271585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.271646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.271854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.271955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.272114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.272255] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.273290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.273544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.273851] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.273963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.274038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.274202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.274326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.274457] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.513694] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 047dd7a9-14b6-4259-b6ee-fbd8eeaa1ec6 [ 642.514735] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.514735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.514735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.514735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.514735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.514735] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:047dd7a9-14b6-4259-b6ee-fbd8eeaa1ec6 already deleted. [ 642.515198] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-047dd7a9-14b6-4259-b6ee-fbd8eeaa1ec6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.560267] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 285a9723-fddf-4aa3-b174-fd5893dd0bb9 [ 642.561499] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.561499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.561499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.561499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.561499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.561499] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:285a9723-fddf-4aa3-b174-fd5893dd0bb9 already deleted. [ 642.561499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-285a9723-fddf-4aa3-b174-fd5893dd0bb9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.776913] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 141d1a4a-af29-49fe-8321-94ad97de005a: rpc.has_security_group_logging(os_id): False [ 642.781057] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.807712] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.807712] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.807712] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.807712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.808453] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.808453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.808453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.808453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.808453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.808453] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be created. [ 642.890982] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.891310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.891310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.892194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.892398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.908159] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 643.283248] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.786112] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.786308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.786382] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.786683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.786776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.786903] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 643.826102] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.826102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.826102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.826102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.826102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.842600] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 644.003862] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 in Status: SUCCESS [ 644.003862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.059126] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 644.059205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.059436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.059750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.059952] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.060144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.060232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.060407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.060534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.060634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.064755] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.567156] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.567508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.567508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.567618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.567780] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.568552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.568716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.568903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.568903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.568987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.569157] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.569257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.569319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.569710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.569771] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.569938] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.570183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.570318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.570402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.570486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.570580] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.927211] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 644.929131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.929131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.929131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.929131] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.005013] env[66854]: INFO networking_nsxv3.common.synchronization [None req-bfd56dc3-c13b-4c97-a32a-90389c23ab29 None None] Enqueued Resource ID: c1f8d2c3-0dbd-4d8c-af70-f3d5e8fbd5d7 with Priority: HIGHEST for action port [ 645.005569] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1f8d2c3-0dbd-4d8c-af70-f3d5e8fbd5d7 with Priority: HIGHEST for action port [ 645.005870] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1f8d2c3-0dbd-4d8c-af70-f3d5e8fbd5d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.005993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1f8d2c3-0dbd-4d8c-af70-f3d5e8fbd5d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.007395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1f8d2c3-0dbd-4d8c-af70-f3d5e8fbd5d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.007654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1f8d2c3-0dbd-4d8c-af70-f3d5e8fbd5d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.007737] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1f8d2c3-0dbd-4d8c-af70-f3d5e8fbd5d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.073475] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87b57f10-d9c1-422b-ae4f-428ffd202f74: rpc.has_security_group_logging(os_id): False [ 645.097024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.097024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.097024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.097024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.097764] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.097764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.097764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.097764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.097764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.097764] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be created. [ 645.167122] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.167122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.167122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.167122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.167122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.181269] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 645.431562] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.431775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.510505] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1f8d2c3-0dbd-4d8c-af70-f3d5e8fbd5d7 [ 645.510864] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.511036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.511138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.511354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.512703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.512703] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1f8d2c3-0dbd-4d8c-af70-f3d5e8fbd5d7 already deleted. [ 645.512703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1f8d2c3-0dbd-4d8c-af70-f3d5e8fbd5d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.694643] env[66854]: INFO networking_nsxv3.common.synchronization [None req-5f3eee01-7823-453f-9365-d1d17f8ce174 None None] Enqueued Resource ID: 9fda5420-60a9-41de-ac3f-2eaf737ccc60 with Priority: HIGHEST for action port [ 645.697031] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fda5420-60a9-41de-ac3f-2eaf737ccc60 with Priority: HIGHEST for action port [ 645.697237] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fda5420-60a9-41de-ac3f-2eaf737ccc60 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.697237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fda5420-60a9-41de-ac3f-2eaf737ccc60" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.697682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fda5420-60a9-41de-ac3f-2eaf737ccc60" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.697682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fda5420-60a9-41de-ac3f-2eaf737ccc60" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.697682] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fda5420-60a9-41de-ac3f-2eaf737ccc60',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.853553] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 645.853807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.853972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.854231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.854467] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.854605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.854723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.854874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.854960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.855070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.855170] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.074711] env[66854]: INFO networking_nsxv3.common.synchronization [None req-647dd311-16bd-4881-9347-f417baf663e7 None None] Enqueued Resource ID: 2cdccfc7-4a18-4671-91b7-ba8779c3737f with Priority: HIGHEST for action port [ 646.078501] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cdccfc7-4a18-4671-91b7-ba8779c3737f with Priority: HIGHEST for action port [ 646.078501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cdccfc7-4a18-4671-91b7-ba8779c3737f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.078501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cdccfc7-4a18-4671-91b7-ba8779c3737f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.078501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cdccfc7-4a18-4671-91b7-ba8779c3737f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.078501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cdccfc7-4a18-4671-91b7-ba8779c3737f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.078501] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cdccfc7-4a18-4671-91b7-ba8779c3737f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.202886] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fda5420-60a9-41de-ac3f-2eaf737ccc60 [ 646.203136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.203267] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.203335] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.203809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.203809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.203809] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fda5420-60a9-41de-ac3f-2eaf737ccc60 already deleted. [ 646.204737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fda5420-60a9-41de-ac3f-2eaf737ccc60" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.358791] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.359084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.359084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.359241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.359414] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.359516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.359584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.359734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.359818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.359908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.360069] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.360327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.360327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.360441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.360489] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.361123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.361123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.361123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.361123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.361123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.361123] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.503815] env[66854]: INFO networking_nsxv3.common.synchronization [None req-98dceaf2-0259-4e96-8e72-bff1d8931132 None None] Enqueued Resource ID: 0a101d65-c67b-4699-afe4-a841e79efdd4 with Priority: HIGHEST for action port [ 646.503815] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a101d65-c67b-4699-afe4-a841e79efdd4 with Priority: HIGHEST for action port [ 646.504400] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a101d65-c67b-4699-afe4-a841e79efdd4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.507321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a101d65-c67b-4699-afe4-a841e79efdd4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.507430] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a101d65-c67b-4699-afe4-a841e79efdd4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.507730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a101d65-c67b-4699-afe4-a841e79efdd4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.507831] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a101d65-c67b-4699-afe4-a841e79efdd4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.581420] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cdccfc7-4a18-4671-91b7-ba8779c3737f [ 646.582807] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.582807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.582807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.582807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.582807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.582807] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cdccfc7-4a18-4671-91b7-ba8779c3737f already deleted. [ 646.582807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cdccfc7-4a18-4671-91b7-ba8779c3737f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.856847] env[66854]: INFO networking_nsxv3.common.synchronization [req-fe18c873-f40d-40c4-9113-3e742d6ba482 req-79f644ef-900c-4c7a-a110-8a922a343fe2 tempest-ServersV294TestFqdnHostnames-1797053889 tempest-ServersV294TestFqdnHostnames-1797053889-project-member] Enqueued Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_members [ 646.857418] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_members [ 646.857725] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.857857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.857931] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.858720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.859341] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.859459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.859528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.859703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.859987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.859987] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.863442] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 141d1a4a-af29-49fe-8321-94ad97de005a: rpc.has_security_group_logging(os_id): False [ 646.891441] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.891590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.891590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.895851] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.895851] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.895851] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.895851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.896906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.896906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.896906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.896906] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 646.980452] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.980586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.980586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.981222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.981222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.998523] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 647.013670] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a101d65-c67b-4699-afe4-a841e79efdd4 [ 647.013904] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.014058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.014131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.014409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.014469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.014530] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a101d65-c67b-4699-afe4-a841e79efdd4 already deleted. [ 647.014599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a101d65-c67b-4699-afe4-a841e79efdd4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.213856] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 647.216350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.362987] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.362987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.363309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.363309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.363848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.363848] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.363848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.364151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.364151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.364240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.364276] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa already deleted. [ 647.364392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.523047] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.523335] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-794" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.524256] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-794" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.524450] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-794" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.524818] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.525111] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.525486] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.525486] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.525631] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.525874] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.525983] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.526138] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.526264] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.526523] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.526523] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.526630] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.552929] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.552929] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.552929] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.552929] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-794" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.553156] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-5098176e-12d2-4444-97f5-658b58036688 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.553302] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-5098176e-12d2-4444-97f5-658b58036688" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.553471] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-5098176e-12d2-4444-97f5-658b58036688" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.554199] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-5098176e-12d2-4444-97f5-658b58036688" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.554199] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5098176e-12d2-4444-97f5-658b58036688',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.057567] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.057567] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.057567] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.057567] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.057869] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.058077] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 5098176e-12d2-4444-97f5-658b58036688 not found, creating... [ 648.058360] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.058623] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.058623] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.058872] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.059031] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.059319] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.059580] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.061467] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.061555] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.061679] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.063020] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 5098176e-12d2-4444-97f5-658b58036688 is going to be created. [ 648.089591] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.089991] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.090281] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.090650] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.091036] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.091380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-5098176e-12d2-4444-97f5-658b58036688" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.728818] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e50e14a5-31f1-487e-8a6a-79fe1a148c22 None None] Enqueued Resource ID: 5da1336e-73ec-40e8-9684-aebb45748359 with Priority: HIGHEST for action port [ 648.729753] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da1336e-73ec-40e8-9684-aebb45748359 with Priority: HIGHEST for action port [ 648.729952] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-5da1336e-73ec-40e8-9684-aebb45748359 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.731143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5da1336e-73ec-40e8-9684-aebb45748359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.731261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5da1336e-73ec-40e8-9684-aebb45748359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.731500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5da1336e-73ec-40e8-9684-aebb45748359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.731619] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5da1336e-73ec-40e8-9684-aebb45748359',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.789617] env[66854]: INFO networking_nsxv3.common.synchronization [req-fe18c873-f40d-40c4-9113-3e742d6ba482 req-584d0eea-eaa0-42c9-b9d3-cd7ca027ef87 service nova] Enqueued Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_rules [ 648.789794] env[66854]: INFO networking_nsxv3.common.synchronization [req-fe18c873-f40d-40c4-9113-3e742d6ba482 req-584d0eea-eaa0-42c9-b9d3-cd7ca027ef87 service nova] Enqueued Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_members [ 648.789928] env[66854]: INFO networking_nsxv3.common.synchronization [req-fe18c873-f40d-40c4-9113-3e742d6ba482 req-584d0eea-eaa0-42c9-b9d3-cd7ca027ef87 service nova] Enqueued Resource ID: 5098176e-12d2-4444-97f5-658b58036688 with Priority: HIGHEST for action port [ 648.790486] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_rules [ 648.790622] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_members [ 648.790722] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5098176e-12d2-4444-97f5-658b58036688 with Priority: HIGHEST for action port [ 648.790990] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.791194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.791264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.791518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.791639] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.792588] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.792714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.792783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.793182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.793377] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.793475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.793567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.793744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.793809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.793913] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.794780] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-5098176e-12d2-4444-97f5-658b58036688 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.794916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5098176e-12d2-4444-97f5-658b58036688" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.794996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5098176e-12d2-4444-97f5-658b58036688" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.795152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5098176e-12d2-4444-97f5-658b58036688" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.795229] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5098176e-12d2-4444-97f5-658b58036688',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.899200] env[66854]: INFO networking_nsxv3.common.synchronization [None req-af3bb140-6023-4b7a-8ab9-3fbfe0f5c16c None None] Enqueued Resource ID: 3974cb45-2eb1-4a93-9956-c0360c2919bc with Priority: HIGHEST for action port [ 648.899200] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3974cb45-2eb1-4a93-9956-c0360c2919bc with Priority: HIGHEST for action port [ 648.899386] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3974cb45-2eb1-4a93-9956-c0360c2919bc taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.899686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3974cb45-2eb1-4a93-9956-c0360c2919bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.899905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3974cb45-2eb1-4a93-9956-c0360c2919bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.901454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3974cb45-2eb1-4a93-9956-c0360c2919bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.901454] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3974cb45-2eb1-4a93-9956-c0360c2919bc',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.022400] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 649.022738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.023431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.023636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.023774] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.236913] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5da1336e-73ec-40e8-9684-aebb45748359 [ 649.237923] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.237923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.237923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.238207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.238244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.238389] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5da1336e-73ec-40e8-9684-aebb45748359 already deleted. [ 649.238474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5da1336e-73ec-40e8-9684-aebb45748359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.297255] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.298510] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.298966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.298966] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5098176e-12d2-4444-97f5-658b58036688 with status ACTIVE [ 649.298966] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.299142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.299142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.300740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.300740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.300740] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.300740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.300740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.300740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.300740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.300740] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.300740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.301549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.301549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.301549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.301549] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5098176e-12d2-4444-97f5-658b58036688 is going to be updated. [ 649.331464] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.331464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.331464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.331464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.331464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.331464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5098176e-12d2-4444-97f5-658b58036688" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.338633] env[66854]: INFO networking_nsxv3.common.synchronization [req-05f6fbbf-4616-4fd6-a000-9342a7a1f8e8 req-420d6124-2132-40c4-b4c0-5698adc1c4b0 tempest-DeleteServersAdminTestJSON-726452509 tempest-DeleteServersAdminTestJSON-726452509-project-admin] Enqueued Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 649.339214] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 649.339834] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.339834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.339834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.340081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.341453] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.341691] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.341783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.342071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.342167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.342313] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.405399] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3974cb45-2eb1-4a93-9956-c0360c2919bc [ 649.405399] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.405641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.405641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.405823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.405918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.406063] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3974cb45-2eb1-4a93-9956-c0360c2919bc already deleted. [ 649.406110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3974cb45-2eb1-4a93-9956-c0360c2919bc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.530117] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.530286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.530402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.530625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.530794] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.530899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.530963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.531128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.531216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.531305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.531397] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.693900] env[66854]: INFO networking_nsxv3.common.synchronization [req-b5276836-522b-48f3-bc70-28087c6ed621 req-7115e62e-cdd7-40c4-a8d2-6adeb8ab16ce tempest-MultipleCreateTestJSON-768742875 tempest-MultipleCreateTestJSON-768742875-project-member] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 649.694728] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 649.695617] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.696148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.696266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.697133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.698191] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.698191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.698191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.698191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.698191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.698191] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.804187] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.831931] env[66854]: INFO networking_nsxv3.common.synchronization [None req-c25646a9-0911-425a-8118-bc8f228b6c31 None None] Enqueued Resource ID: 9e6cc80b-4a5b-453e-891b-6c3d77be2d9a with Priority: HIGHEST for action port [ 649.832732] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e6cc80b-4a5b-453e-891b-6c3d77be2d9a with Priority: HIGHEST for action port [ 649.833453] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e6cc80b-4a5b-453e-891b-6c3d77be2d9a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.835160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e6cc80b-4a5b-453e-891b-6c3d77be2d9a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.835160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e6cc80b-4a5b-453e-891b-6c3d77be2d9a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.835160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e6cc80b-4a5b-453e-891b-6c3d77be2d9a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.835160] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e6cc80b-4a5b-453e-891b-6c3d77be2d9a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.846608] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.846608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.846608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.846786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.846821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.847115] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.847115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.847288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.847288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.847362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.847444] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 is going to be updated. [ 649.889020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.889020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.889020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.889020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.889302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.901969] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: IN_PROGRESS for 2s [ 650.034347] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.034760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.034900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.035157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.035982] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.035982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.035982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.035982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.035982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.035982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.036540] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.036540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.036540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.036540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.036756] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.036756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.036756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.036927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.036974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.037456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.037577] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.128954] env[66854]: INFO networking_nsxv3.common.synchronization [req-dc7a90e3-83a6-4982-9789-927664e7f9f6 req-a5922925-7eaa-4091-8fa9-85e50bae5282 tempest-MigrationsAdminTest-1593966740 tempest-MigrationsAdminTest-1593966740-project-member] Enqueued Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 650.128954] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 650.128954] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.128954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.128954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.128954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.130952] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.130952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.130952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.130952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.130952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.130952] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.200465] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.306356] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.306513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.306587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.306929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.306929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.307048] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa is going to be created. [ 650.339128] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.339128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.339274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.339876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.340184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.341925] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e6cc80b-4a5b-453e-891b-6c3d77be2d9a [ 650.342755] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.343504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.343504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.343504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.343504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.343504] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e6cc80b-4a5b-453e-891b-6c3d77be2d9a already deleted. [ 650.343964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e6cc80b-4a5b-453e-891b-6c3d77be2d9a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.356279] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa in Status: UNINITIALIZED for 2s [ 650.539677] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 141d1a4a-af29-49fe-8321-94ad97de005a: rpc.has_security_group_logging(os_id): False [ 650.562274] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.562495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.562571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.562795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.562892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.563113] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.563215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.563278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.563716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.563716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.563828] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.563906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.563973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.564147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.564222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.564437] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.564533] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.564610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.564752] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.564825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.564907] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 650.568702] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.568868] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.569708] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.569708] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.569708] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.569978] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.569978] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.573469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.573469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.573469] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.573469] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.573469] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.573469] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.573469] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.573469] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.573469] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.633334] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.633508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.633578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.633884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.634055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.634193] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.634591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.634591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.634591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.634591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.634818] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 already deleted. [ 650.634818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.674160] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.674160] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.103 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.674317] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.674392] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.674794] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-5a0f0f72-ccd4-4971-9de0-157051678379 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.675147] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-5a0f0f72-ccd4-4971-9de0-157051678379" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.675208] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-5a0f0f72-ccd4-4971-9de0-157051678379" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.678045] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-5a0f0f72-ccd4-4971-9de0-157051678379" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.678045] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a0f0f72-ccd4-4971-9de0-157051678379',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.703151] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.743375] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.743583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.743667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.743933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.744110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.767339] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 651.057690] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e05803ce-6dbd-4eba-ac4c-c31b0480b5fc None None] Enqueued Resource ID: 8454fa5b-0471-4ca2-a2ce-6d5eab4222d5 with Priority: HIGHEST for action port [ 651.058459] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8454fa5b-0471-4ca2-a2ce-6d5eab4222d5 with Priority: HIGHEST for action port [ 651.058781] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8454fa5b-0471-4ca2-a2ce-6d5eab4222d5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.058943] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8454fa5b-0471-4ca2-a2ce-6d5eab4222d5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.059016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8454fa5b-0471-4ca2-a2ce-6d5eab4222d5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.059239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8454fa5b-0471-4ca2-a2ce-6d5eab4222d5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.059395] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8454fa5b-0471-4ca2-a2ce-6d5eab4222d5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.183735] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.183735] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.183735] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.183735] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.184744] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.184744] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 5a0f0f72-ccd4-4971-9de0-157051678379 not found, creating... [ 651.185024] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.185181] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.185290] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.185525] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.185655] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.185933] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.186251] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.186379] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.186588] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.186717] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.186855] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 5a0f0f72-ccd4-4971-9de0-157051678379 is going to be created. [ 651.206698] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.206922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.207019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.207629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.207629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.207629] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 651.212699] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.212699] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.212699] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.212699] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.212699] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.212699] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-5a0f0f72-ccd4-4971-9de0-157051678379" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.245893] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.246609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.246609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.246609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.246609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.257355] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 651.561551] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8454fa5b-0471-4ca2-a2ce-6d5eab4222d5 [ 651.561950] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.562122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.562193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.562424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.562598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.562598] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8454fa5b-0471-4ca2-a2ce-6d5eab4222d5 already deleted. [ 651.562689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8454fa5b-0471-4ca2-a2ce-6d5eab4222d5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.915401] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: SUCCESS [ 651.915401] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 deletion is rescheduled due to dependency. [ 651.915401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.018776] env[66854]: INFO networking_nsxv3.common.synchronization [req-dc7a90e3-83a6-4982-9789-927664e7f9f6 req-662ef0bb-97f0-461e-a93f-de981ff8ad81 service nova] Enqueued Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_rules [ 652.019190] env[66854]: INFO networking_nsxv3.common.synchronization [req-dc7a90e3-83a6-4982-9789-927664e7f9f6 req-662ef0bb-97f0-461e-a93f-de981ff8ad81 service nova] Enqueued Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 652.019428] env[66854]: INFO networking_nsxv3.common.synchronization [req-dc7a90e3-83a6-4982-9789-927664e7f9f6 req-662ef0bb-97f0-461e-a93f-de981ff8ad81 service nova] Enqueued Resource ID: 5a0f0f72-ccd4-4971-9de0-157051678379 with Priority: HIGHEST for action port [ 652.020916] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_rules [ 652.020916] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 652.020916] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a0f0f72-ccd4-4971-9de0-157051678379 with Priority: HIGHEST for action port [ 652.021124] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.021891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.021891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.022147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.022238] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.023469] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.023469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.023469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.023708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.023881] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.023996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.024055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.025063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.025063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.025063] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.025891] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a0f0f72-ccd4-4971-9de0-157051678379 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.025891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a0f0f72-ccd4-4971-9de0-157051678379" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.025891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a0f0f72-ccd4-4971-9de0-157051678379" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.025891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a0f0f72-ccd4-4971-9de0-157051678379" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.025891] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a0f0f72-ccd4-4971-9de0-157051678379',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.370420] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa in Status: SUCCESS [ 652.370972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.370972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.371167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.375867] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.375867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.375867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.375867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.376256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.376256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.376256] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.531727] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.531727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.531911] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.535896] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a0f0f72-ccd4-4971-9de0-157051678379 with status ACTIVE [ 652.535896] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.535896] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.535896] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.535896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.535896] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a0f0f72-ccd4-4971-9de0-157051678379 is going to be updated. [ 652.581754] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.581754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.581754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.581754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.581754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.582128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a0f0f72-ccd4-4971-9de0-157051678379" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.795275] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 652.795755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.881433] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.042029] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.269862] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 653.270694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.384339] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 202dfdd2-4f71-40b3-a725-b25d1a9dfafa: rpc.has_security_group_logging(os_id): False [ 653.408416] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.408750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.408828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.409336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.409336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.409552] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.409688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.409688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.409864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.409942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.410070] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa is going to be created. [ 653.512636] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.512799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.512860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.513055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.513246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.529139] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa in Status: IN_PROGRESS for 2s [ 653.546376] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.546625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.546737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.547079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.547225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.547522] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 is going to be created. [ 653.640555] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.640881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.641025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.641365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.641713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.656643] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: UNINITIALIZED for 2s [ 654.776187] env[66854]: INFO networking_nsxv3.common.synchronization [req-4e0d3e01-15d2-4916-a936-0e13a73a7e01 req-d708aef3-3943-4eb5-bced-23ea6f1e9025 tempest-MultipleCreateTestJSON-768742875 tempest-MultipleCreateTestJSON-768742875-project-member] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 654.776711] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 654.777043] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.777227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.777543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.778856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.779076] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.779436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.779436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.779622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.779622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.779968] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.200913] env[66854]: INFO networking_nsxv3.common.synchronization [req-ee13be3c-723d-4c74-be72-7080e8035544 req-092de631-9778-4852-991d-6ac1432f1d09 tempest-ServerExternalEventsTest-1149133109 tempest-ServerExternalEventsTest-1149133109-project-member] Enqueued Resource ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 with Priority: HIGHEST for action security_group_members [ 655.201652] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 with Priority: HIGHEST for action security_group_members [ 655.205043] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-480a784d-e1e2-4919-8cb1-9c77138c1be4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.205043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.205043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.205043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.205043] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.205043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.205043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.205043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.205043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.205043] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480a784d-e1e2-4919-8cb1-9c77138c1be4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.286020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.286271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.286494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.286708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.286853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.287104] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.287222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.287325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.287488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.287641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.287752] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 655.337955] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.338208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.338279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.338458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.338607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.357454] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 655.544885] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa in Status: SUCCESS [ 655.545115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.668161] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: SUCCESS [ 655.669925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.670168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.670526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.670657] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.670850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.671014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.671236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.671236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.671343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.671556] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.694411] env[66854]: INFO networking_nsxv3.common.synchronization [req-0fdd312d-2593-4175-9044-2b62c465b7d4 req-2d03ae9c-2453-4b80-ae04-323ad84e547f tempest-ServerDiagnosticsTest-1418191994 tempest-ServerDiagnosticsTest-1418191994-project-member] Enqueued Resource ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d with Priority: HIGHEST for action security_group_members [ 655.694608] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d with Priority: HIGHEST for action security_group_members [ 655.695683] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b47b969-b701-468c-8b2e-9e8473ecb61d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.695683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.695683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.695683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.695683] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.695952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.695952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.695952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.696155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.696764] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b47b969-b701-468c-8b2e-9e8473ecb61d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.708024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.708024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.708024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.708024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.708024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.708024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.708024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.708024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.708024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.708024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.708024] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 is going to be updated. [ 655.734935] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.735396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.735487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.735785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.735976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.746374] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 in Status: IN_PROGRESS for 2s [ 656.176316] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.176316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.176316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.176316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.176316] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.176316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.176316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.176865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.176865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.176865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.176865] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.176865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.177029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.177151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.177239] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.177357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.177401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.177525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.177599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.177681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.178534] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.200907] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.200907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.200907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.200907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.200907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.202518] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.202518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.202518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.202518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.202518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.202518] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d is going to be updated. [ 656.232094] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.232270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.232358] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.232639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.232715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.244119] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d in Status: IN_PROGRESS for 2s [ 656.276423] env[66854]: INFO networking_nsxv3.common.synchronization [None req-dc55c3d0-7035-4d53-a19c-eebe7088cd92 tempest-ServersWithSpecificFlavorTestJSON-1363282919 tempest-ServersWithSpecificFlavorTestJSON-1363282919-project-member] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_rules [ 656.276791] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_rules [ 656.279070] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.279070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.279070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.279350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.279350] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.448195] env[66854]: INFO networking_nsxv3.common.synchronization [None req-81925c9f-3d48-4f3b-b69a-0c16a5b9f90d tempest-ServersWithSpecificFlavorTestJSON-1363282919 tempest-ServersWithSpecificFlavorTestJSON-1363282919-project-member] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_rules [ 656.449617] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_rules [ 656.450009] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.450154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.681027] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7025fd1c-e490-40e6-9db4-8ead9e399bb5: rpc.has_security_group_logging(os_id): False [ 656.702053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.702339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.702339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.702512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.702564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.702779] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.702913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.702913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.703097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.703152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.703356] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.703451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.703517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.703653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.703732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.703937] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.704048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.704103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.704280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.704341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.704392] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 is going to be created. [ 656.762329] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.762657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.762657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.762789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.762960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.778594] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: IN_PROGRESS for 2s [ 656.805657] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.805966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.805966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.806225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.806321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.806458] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e already deleted. [ 656.806550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.806703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.806925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.807030] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.365071] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.365914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.365914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.365914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.365914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.366137] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e already deleted. [ 657.366279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.371107] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 657.371385] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 deletion is rescheduled due to dependency. [ 657.371554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.762860] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 in Status: SUCCESS [ 657.762860] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 deletion is rescheduled due to dependency. [ 657.762860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.232167] env[66854]: INFO networking_nsxv3.common.synchronization [None req-6386a61c-9dae-4ce6-a03a-2352cc060c6d None None] Enqueued Resource ID: fd572871-13e4-45c1-93b9-e3a358a1ae84 with Priority: HIGHEST for action port [ 658.232167] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd572871-13e4-45c1-93b9-e3a358a1ae84 with Priority: HIGHEST for action port [ 658.232167] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd572871-13e4-45c1-93b9-e3a358a1ae84 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.232846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd572871-13e4-45c1-93b9-e3a358a1ae84" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.233109] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd572871-13e4-45c1-93b9-e3a358a1ae84" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.233537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd572871-13e4-45c1-93b9-e3a358a1ae84" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.233727] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd572871-13e4-45c1-93b9-e3a358a1ae84',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.257838] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d in Status: IN_PROGRESS for 4s [ 658.736643] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd572871-13e4-45c1-93b9-e3a358a1ae84 [ 658.737161] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.737161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.737161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.737935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.737935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.737935] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd572871-13e4-45c1-93b9-e3a358a1ae84 already deleted. [ 658.737935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd572871-13e4-45c1-93b9-e3a358a1ae84" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.798470] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: SUCCESS [ 658.798801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.388838] env[66854]: INFO networking_nsxv3.common.synchronization [None req-47c73131-08e0-49c9-950a-f641e2f14b38 None None] Enqueued Resource ID: f13d7ea6-1852-4879-a4f6-ba5f02eacb34 with Priority: HIGHEST for action port [ 659.389500] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f13d7ea6-1852-4879-a4f6-ba5f02eacb34 with Priority: HIGHEST for action port [ 659.389852] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f13d7ea6-1852-4879-a4f6-ba5f02eacb34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.389988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f13d7ea6-1852-4879-a4f6-ba5f02eacb34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.398772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f13d7ea6-1852-4879-a4f6-ba5f02eacb34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.399091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f13d7ea6-1852-4879-a4f6-ba5f02eacb34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.399281] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f13d7ea6-1852-4879-a4f6-ba5f02eacb34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.903501] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f13d7ea6-1852-4879-a4f6-ba5f02eacb34 [ 659.903501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.903501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.903501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.903501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.903501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.903501] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f13d7ea6-1852-4879-a4f6-ba5f02eacb34 already deleted. [ 659.903501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f13d7ea6-1852-4879-a4f6-ba5f02eacb34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.274248] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d in Status: SUCCESS [ 660.274248] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d deletion is rescheduled due to dependency. [ 660.274248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.219284] env[66854]: INFO networking_nsxv3.common.synchronization [req-3f83392e-a525-4af3-bf5d-27fb4fb512fc req-701542b7-aee2-431b-9261-c1a56f6ce52a tempest-FloatingIPsAssociationTestJSON-1643548393 tempest-FloatingIPsAssociationTestJSON-1643548393-project-member] Enqueued Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 661.219284] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 661.219284] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.219284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.219284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.219284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.220447] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.220447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.220447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.220447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.220447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.220447] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.403369] env[66854]: INFO networking_nsxv3.common.synchronization [None req-614a6c6f-ab47-4cb3-b0b3-c86d41c6c8bc None None] Enqueued Resource ID: 8780f3d2-f4a0-4e72-97eb-44a33ca7f587 with Priority: HIGHEST for action port [ 661.403964] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8780f3d2-f4a0-4e72-97eb-44a33ca7f587 with Priority: HIGHEST for action port [ 661.406537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8780f3d2-f4a0-4e72-97eb-44a33ca7f587 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.406690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8780f3d2-f4a0-4e72-97eb-44a33ca7f587" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.406754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8780f3d2-f4a0-4e72-97eb-44a33ca7f587" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.406990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8780f3d2-f4a0-4e72-97eb-44a33ca7f587" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.407083] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8780f3d2-f4a0-4e72-97eb-44a33ca7f587',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.689895] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-272 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.690306] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-272" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.690422] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-272" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.690778] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-272" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.691194] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.691847] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.691847] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.691847] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.692128] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.692441] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.692643] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.692816] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.693020] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.693200] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.693351] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.693548] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.715735] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.715974] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 661.716118] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.716328] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-272" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.716678] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-cef4fac1-a2c6-4111-a35a-777c8e563e30 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.718788] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-cef4fac1-a2c6-4111-a35a-777c8e563e30" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.718788] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-cef4fac1-a2c6-4111-a35a-777c8e563e30" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.718788] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-cef4fac1-a2c6-4111-a35a-777c8e563e30" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.718788] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef4fac1-a2c6-4111-a35a-777c8e563e30',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.723752] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.910060] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8780f3d2-f4a0-4e72-97eb-44a33ca7f587 [ 661.910337] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.910512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.910589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.910818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.910942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.911172] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8780f3d2-f4a0-4e72-97eb-44a33ca7f587 already deleted. [ 661.911172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8780f3d2-f4a0-4e72-97eb-44a33ca7f587" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.223024] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.223024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.223024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.223024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.223024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.223024] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port cef4fac1-a2c6-4111-a35a-777c8e563e30 not found, creating... [ 662.223024] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.223024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.223024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.223024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.223024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.223932] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.223932] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.223932] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.225503] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.225503] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.225503] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: cef4fac1-a2c6-4111-a35a-777c8e563e30 is going to be created. [ 662.228416] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.255917] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.256154] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.256273] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.256528] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.256764] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.256989] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-cef4fac1-a2c6-4111-a35a-777c8e563e30" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.732802] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.732802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.732802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.733543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.733543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.733543] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b68d89c-9278-4047-a0c4-e471d31223ed is going to be updated. [ 662.771817] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.771817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.771817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.771817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.771817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.782452] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: IN_PROGRESS for 2s [ 662.963935] env[66854]: INFO networking_nsxv3.common.synchronization [req-a7b883e2-c1d8-42c3-9a6b-ee6638888bdc req-ed2f22cd-5ba1-428f-b002-1e50b806ea46 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 662.964318] env[66854]: INFO networking_nsxv3.common.synchronization [req-a7b883e2-c1d8-42c3-9a6b-ee6638888bdc req-ed2f22cd-5ba1-428f-b002-1e50b806ea46 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_members [ 662.964763] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 662.965304] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_members [ 662.965304] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.965500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.965500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.965783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.965925] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.966127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.966213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.966416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.966565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.967099] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.968956] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.968956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.968956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.968956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.968956] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.968956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.969461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.969461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.969461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.969572] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.034234] env[66854]: INFO networking_nsxv3.common.synchronization [req-a7b883e2-c1d8-42c3-9a6b-ee6638888bdc req-ed2f22cd-5ba1-428f-b002-1e50b806ea46 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_rules [ 663.034440] env[66854]: INFO networking_nsxv3.common.synchronization [req-a7b883e2-c1d8-42c3-9a6b-ee6638888bdc req-ed2f22cd-5ba1-428f-b002-1e50b806ea46 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_members [ 663.034549] env[66854]: INFO networking_nsxv3.common.synchronization [req-a7b883e2-c1d8-42c3-9a6b-ee6638888bdc req-ed2f22cd-5ba1-428f-b002-1e50b806ea46 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 663.034654] env[66854]: INFO networking_nsxv3.common.synchronization [req-a7b883e2-c1d8-42c3-9a6b-ee6638888bdc req-ed2f22cd-5ba1-428f-b002-1e50b806ea46 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 663.034784] env[66854]: INFO networking_nsxv3.common.synchronization [req-a7b883e2-c1d8-42c3-9a6b-ee6638888bdc req-ed2f22cd-5ba1-428f-b002-1e50b806ea46 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 8475678a-6dc0-420e-8764-60089d7359b9 with Priority: HIGHEST for action port [ 663.036563] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_rules [ 663.037024] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 663.037380] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8475678a-6dc0-420e-8764-60089d7359b9 with Priority: HIGHEST for action port [ 663.037556] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_members [ 663.037688] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 663.038395] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.038551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.041770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.041770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.041770] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.041770] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.041770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.041770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.041770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.041770] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.042330] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8475678a-6dc0-420e-8764-60089d7359b9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.042330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.042330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.042330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.042538] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8475678a-6dc0-420e-8764-60089d7359b9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.045058] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.045058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.045058] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.045058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.049193] env[66854]: INFO networking_nsxv3.common.synchronization [req-3f83392e-a525-4af3-bf5d-27fb4fb512fc req-1399229f-fef1-48ac-8bbd-29e3bf92daa4 service nova] Enqueued Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_rules [ 663.049404] env[66854]: INFO networking_nsxv3.common.synchronization [req-3f83392e-a525-4af3-bf5d-27fb4fb512fc req-1399229f-fef1-48ac-8bbd-29e3bf92daa4 service nova] Enqueued Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 663.049952] env[66854]: INFO networking_nsxv3.common.synchronization [req-3f83392e-a525-4af3-bf5d-27fb4fb512fc req-1399229f-fef1-48ac-8bbd-29e3bf92daa4 service nova] Enqueued Resource ID: cef4fac1-a2c6-4111-a35a-777c8e563e30 with Priority: HIGHEST for action port [ 663.050153] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_rules [ 663.050250] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 663.050365] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef4fac1-a2c6-4111-a35a-777c8e563e30 with Priority: HIGHEST for action port [ 663.050637] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.050761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.050879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.051782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.052515] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.056655] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.056655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.056655] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-cef4fac1-a2c6-4111-a35a-777c8e563e30 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.056655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cef4fac1-a2c6-4111-a35a-777c8e563e30" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.056655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cef4fac1-a2c6-4111-a35a-777c8e563e30" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.056655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cef4fac1-a2c6-4111-a35a-777c8e563e30" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.056655] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef4fac1-a2c6-4111-a35a-777c8e563e30',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.471742] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.472801] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.544420] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8475678a-6dc0-420e-8764-60089d7359b9 with status ACTIVE [ 663.544652] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.544787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.544853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.545131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.545226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.545414] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.545944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.545944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.545944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.545944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.546256] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.546256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.548111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.548111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.548111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.548111] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8475678a-6dc0-420e-8764-60089d7359b9 is going to be updated. [ 663.549339] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.549476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.549655] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.549761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.557890] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.557890] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.559317] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cef4fac1-a2c6-4111-a35a-777c8e563e30 with status ACTIVE [ 663.560037] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.560037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.560037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.560037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.560037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.560287] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.560340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.560723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.560723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.560723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.561020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.561165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.561240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.561663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.561663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.561663] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cef4fac1-a2c6-4111-a35a-777c8e563e30 is going to be updated. [ 663.573691] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.573955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.573955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.574197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.574328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.574489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.589031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.589031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.589031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.589031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.589590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.589590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cef4fac1-a2c6-4111-a35a-777c8e563e30" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.838639] env[66854]: INFO networking_nsxv3.common.synchronization [req-a96424a0-dcac-458a-bd39-35943ad641a0 req-e573681f-84b2-429a-b901-711a470183ef tempest-ServersTestBootFromVolume-1832221709 tempest-ServersTestBootFromVolume-1832221709-project-member] Enqueued Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_members [ 663.838724] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_members [ 663.839285] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-82708b01-13e8-453a-8492-93929a99b850 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.839464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.840359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.841218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.842223] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.842362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.842436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.842880] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.842974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.843042] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.973927] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.978596] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.227855] env[66854]: INFO networking_nsxv3.common.synchronization [None req-8338267c-ec59-4a77-8615-730fb2b54709 None None] Enqueued Resource ID: f4a9c40f-8d95-40a2-992e-96265e094947 with Priority: HIGHEST for action port [ 664.228740] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a9c40f-8d95-40a2-992e-96265e094947 with Priority: HIGHEST for action port [ 664.228847] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4a9c40f-8d95-40a2-992e-96265e094947 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.229065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4a9c40f-8d95-40a2-992e-96265e094947" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.229065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4a9c40f-8d95-40a2-992e-96265e094947" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.229874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4a9c40f-8d95-40a2-992e-96265e094947" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.229874] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4a9c40f-8d95-40a2-992e-96265e094947',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.345779] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.346092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.346092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.346290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.346290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.346532] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.346640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.346706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.346925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.346960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.347045] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82708b01-13e8-453a-8492-93929a99b850 already deleted. [ 664.347107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.358620] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.358819] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-697" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.358937] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-697" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.359391] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-697" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.359566] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.359741] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.359858] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.360091] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.360233] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.360432] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.360538] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.360641] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.360743] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.360839] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.360936] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.361081] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.388918] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.388918] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.388918] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.389147] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-697" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.391678] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-ba51902e-d52f-4c5d-b938-c48ba1be5da4 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.391678] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-ba51902e-d52f-4c5d-b938-c48ba1be5da4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.391678] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-ba51902e-d52f-4c5d-b938-c48ba1be5da4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.391678] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-ba51902e-d52f-4c5d-b938-c48ba1be5da4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.391678] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba51902e-d52f-4c5d-b938-c48ba1be5da4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.480233] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.480692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.480692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.480806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.480861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.480953] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 664.482404] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.482565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.482565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.482733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.482810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.482897] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522304fc-ecb3-47d1-844c-54013760964c is going to be created. [ 664.515228] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.515379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.515447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.515663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.515911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.521279] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.521420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.521496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.521699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.521980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.528045] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: UNINITIALIZED for 2s [ 664.530548] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 664.735139] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4a9c40f-8d95-40a2-992e-96265e094947 [ 664.735378] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.735529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.735603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.735800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.736055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.736133] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4a9c40f-8d95-40a2-992e-96265e094947 already deleted. [ 664.736171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4a9c40f-8d95-40a2-992e-96265e094947" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.794357] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: SUCCESS [ 664.794462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.794606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.794854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.795121] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.795210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.795281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.795444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.795543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.795647] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.898039] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.898282] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.898443] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.898785] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.898981] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.899187] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port ba51902e-d52f-4c5d-b938-c48ba1be5da4 not found, creating... [ 664.899493] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.899720] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.899871] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.900456] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.900682] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.901047] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.901246] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.901383] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.901614] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.901793] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.901982] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: ba51902e-d52f-4c5d-b938-c48ba1be5da4 is going to be created. [ 664.929068] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.929285] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.929400] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.929708] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.929901] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.930160] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-ba51902e-d52f-4c5d-b938-c48ba1be5da4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.299041] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.453845] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e34d3b6c-d2a3-499e-92fd-5c37bfe47501 None None] Enqueued Resource ID: 3a7082e9-09bc-440d-bd88-b93115dd6b15 with Priority: HIGHEST for action port [ 665.454403] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7082e9-09bc-440d-bd88-b93115dd6b15 with Priority: HIGHEST for action port [ 665.454704] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a7082e9-09bc-440d-bd88-b93115dd6b15 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.454827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a7082e9-09bc-440d-bd88-b93115dd6b15" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.454897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a7082e9-09bc-440d-bd88-b93115dd6b15" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.457280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a7082e9-09bc-440d-bd88-b93115dd6b15" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.457375] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a7082e9-09bc-440d-bd88-b93115dd6b15',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.620417] env[66854]: INFO networking_nsxv3.common.synchronization [req-a96424a0-dcac-458a-bd39-35943ad641a0 req-92302512-1fd3-4876-a054-270215a41d4e service nova] Enqueued Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_rules [ 665.620417] env[66854]: INFO networking_nsxv3.common.synchronization [req-a96424a0-dcac-458a-bd39-35943ad641a0 req-92302512-1fd3-4876-a054-270215a41d4e service nova] Enqueued Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_members [ 665.621131] env[66854]: INFO networking_nsxv3.common.synchronization [req-a96424a0-dcac-458a-bd39-35943ad641a0 req-92302512-1fd3-4876-a054-270215a41d4e service nova] Enqueued Resource ID: ba51902e-d52f-4c5d-b938-c48ba1be5da4 with Priority: HIGHEST for action port [ 665.622939] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_rules [ 665.623106] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_members [ 665.623307] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba51902e-d52f-4c5d-b938-c48ba1be5da4 with Priority: HIGHEST for action port [ 665.623796] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82708b01-13e8-453a-8492-93929a99b850 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.623954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.624050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.624266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.624350] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.625198] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-82708b01-13e8-453a-8492-93929a99b850 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.626506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.626506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.626506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.626506] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.626506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.626506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.626506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.626855] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.626985] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.627792] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba51902e-d52f-4c5d-b938-c48ba1be5da4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.627906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba51902e-d52f-4c5d-b938-c48ba1be5da4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.627977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba51902e-d52f-4c5d-b938-c48ba1be5da4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.628141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba51902e-d52f-4c5d-b938-c48ba1be5da4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.628213] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba51902e-d52f-4c5d-b938-c48ba1be5da4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.806074] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.838095] env[66854]: INFO networking_nsxv3.common.synchronization [req-4a052e48-57ae-4544-a6e5-418005c9b723 req-ea8ab697-7d0f-45ca-a392-43d2f73ad9c4 tempest-ServersTestMultiNic-36060217 tempest-ServersTestMultiNic-36060217-project-member] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 665.838095] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 665.838095] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.838095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.838095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.839366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.839366] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.839366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.839366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.839366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.839366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.839594] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.960273] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a7082e9-09bc-440d-bd88-b93115dd6b15 [ 665.960556] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.960766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.960766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.961058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.961171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.961331] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a7082e9-09bc-440d-bd88-b93115dd6b15 already deleted. [ 665.961331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a7082e9-09bc-440d-bd88-b93115dd6b15" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.129897] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-82708b01-13e8-453a-8492-93929a99b850 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.130033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.130606] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.131203] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba51902e-d52f-4c5d-b938-c48ba1be5da4 with status ACTIVE [ 666.131373] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.131478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.131541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.131998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.131998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.132105] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.132166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.132201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.132342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.132418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.132595] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.132684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.132744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.132883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.133018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.139090] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba51902e-d52f-4c5d-b938-c48ba1be5da4 is going to be updated. [ 666.161980] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.162160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.162226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.162441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.162580] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.162733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba51902e-d52f-4c5d-b938-c48ba1be5da4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.195783] env[66854]: INFO networking_nsxv3.common.synchronization [req-5443f277-5ab1-4d81-aca5-6c91b6979709 req-347caa33-1f8b-4bb0-88a2-0dcad7069415 tempest-ServersAdminTestJSON-1278843131 tempest-ServersAdminTestJSON-1278843131-project-member] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 666.196359] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 666.196649] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.196862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.196862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.197313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.197492] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.197597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.197659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.199648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.199648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.199648] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.306820] env[66854]: INFO networking_nsxv3.common.synchronization [req-4a052e48-57ae-4544-a6e5-418005c9b723 req-dee3f34b-62c7-44d4-abe6-6df89f88ea50 tempest-ServersTestMultiNic-36060217 tempest-ServersTestMultiNic-36060217-project-member] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 666.307632] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 666.311612] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.311612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.311612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.311612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.311612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.311612] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b68d89c-9278-4047-a0c4-e471d31223ed is going to be updated. [ 666.311612] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.311612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.345236] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.345236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.345236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.345236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.345236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.346087] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.355063] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: IN_PROGRESS for 2s [ 666.543332] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: SUCCESS [ 666.543332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.543332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.543332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.543332] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.543332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.543332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.543332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.543332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.543332] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.544574] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 666.544780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.544962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.545076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.545251] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.545378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.545485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.545781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.545781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.546130] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.640962] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.656343] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.656484] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.656551] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.656890] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.657187] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.657351] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.657474] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.657703] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.657839] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.658069] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.658182] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.658287] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.658390] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.658508] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.658616] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.658745] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.695362] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.695534] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.695719] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.695924] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.696267] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-5e82786d-1f25-4589-a491-2d66fe10540b taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.696434] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-5e82786d-1f25-4589-a491-2d66fe10540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.696549] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-5e82786d-1f25-4589-a491-2d66fe10540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.696916] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-5e82786d-1f25-4589-a491-2d66fe10540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.697032] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e82786d-1f25-4589-a491-2d66fe10540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.705292] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.705292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.705292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.705523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.705558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.705799] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.705921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.706045] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.706277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.706494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.706494] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c already deleted. [ 666.706585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.848200] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.048298] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.050650] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.143308] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.143582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.143582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.143850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.144163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.145111] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82708b01-13e8-453a-8492-93929a99b850 is going to be created. [ 667.172943] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.173233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.173352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.173660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.173938] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.185025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82708b01-13e8-453a-8492-93929a99b850 in Status: UNINITIALIZED for 2s [ 667.200028] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.200155] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.200221] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.200651] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.200711] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.200864] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 5e82786d-1f25-4589-a491-2d66fe10540b not found, creating... [ 667.201152] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.201360] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.201421] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.201696] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.201838] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.202473] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.202473] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.202473] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.202631] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.202720] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.202859] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 5e82786d-1f25-4589-a491-2d66fe10540b is going to be created. [ 667.228718] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.228983] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.229137] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.229467] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.229700] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.229953] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-5e82786d-1f25-4589-a491-2d66fe10540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.351186] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.351626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.351965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.353038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.353038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.353038] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 667.397102] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.397583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.397583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.397703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.397786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.412940] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 667.421877] env[66854]: INFO networking_nsxv3.common.synchronization [req-4a052e48-57ae-4544-a6e5-418005c9b723 req-65f9875f-28b6-4aa1-b39c-98f1297c71f2 tempest-ServersTestMultiNic-36060217 tempest-ServersTestMultiNic-36060217-project-member] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 667.422529] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 667.422873] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.422977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.551696] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.552863] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.961684] env[66854]: INFO networking_nsxv3.common.synchronization [req-5443f277-5ab1-4d81-aca5-6c91b6979709 req-9e894567-c8f0-4564-a15b-79aee8769ade service nova] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_rules [ 667.962389] env[66854]: INFO networking_nsxv3.common.synchronization [req-5443f277-5ab1-4d81-aca5-6c91b6979709 req-9e894567-c8f0-4564-a15b-79aee8769ade service nova] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 667.962389] env[66854]: INFO networking_nsxv3.common.synchronization [req-5443f277-5ab1-4d81-aca5-6c91b6979709 req-9e894567-c8f0-4564-a15b-79aee8769ade service nova] Enqueued Resource ID: 5e82786d-1f25-4589-a491-2d66fe10540b with Priority: HIGHEST for action port [ 667.962795] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_rules [ 667.966123] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 667.966123] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e82786d-1f25-4589-a491-2d66fe10540b with Priority: HIGHEST for action port [ 667.966123] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.966123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.966123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.966123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.966123] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.966123] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.966123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.966123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.966123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.966123] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.966123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.966123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.967250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.967250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.968306] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.969501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e82786d-1f25-4589-a491-2d66fe10540b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.969501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e82786d-1f25-4589-a491-2d66fe10540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.969501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e82786d-1f25-4589-a491-2d66fe10540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.969501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e82786d-1f25-4589-a491-2d66fe10540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.969501] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e82786d-1f25-4589-a491-2d66fe10540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.055171] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.055427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.055512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.055700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.055928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.056056] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522304fc-ecb3-47d1-844c-54013760964c is going to be updated. [ 668.057382] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.057572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.057572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.057735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.057870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.057925] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 668.088433] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.088748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.088748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.088861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.089023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.090868] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.091029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.091078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.091234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.091413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.102397] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 668.102397] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: IN_PROGRESS for 2s [ 668.342038] env[66854]: INFO networking_nsxv3.common.synchronization [None req-540325ca-5548-4012-aeb7-a2f33084a01e None None] Enqueued Resource ID: e7eac1c9-6bbd-4462-81ae-3b1692a06d4a with Priority: HIGHEST for action port [ 668.342709] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7eac1c9-6bbd-4462-81ae-3b1692a06d4a with Priority: HIGHEST for action port [ 668.343264] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7eac1c9-6bbd-4462-81ae-3b1692a06d4a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.343400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7eac1c9-6bbd-4462-81ae-3b1692a06d4a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.343400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7eac1c9-6bbd-4462-81ae-3b1692a06d4a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.354675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7eac1c9-6bbd-4462-81ae-3b1692a06d4a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.354866] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7eac1c9-6bbd-4462-81ae-3b1692a06d4a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.370660] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: SUCCESS [ 668.370660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.370660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.370660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.370660] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.370660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.370660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.370660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.370660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.370660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.370660] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.473160] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.473160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.473160] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.473349] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e82786d-1f25-4589-a491-2d66fe10540b with status ACTIVE [ 668.473461] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.473585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.473644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.473846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.473930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.474176] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.474272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.474509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.474509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.474590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.474787] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.475397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.475397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.477564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.477564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.477632] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e82786d-1f25-4589-a491-2d66fe10540b is going to be updated. [ 668.502375] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.503137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.503137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.503327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.503683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.503683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e82786d-1f25-4589-a491-2d66fe10540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.859272] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7eac1c9-6bbd-4462-81ae-3b1692a06d4a [ 668.859272] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.859272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.859573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.859573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.859687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.859752] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7eac1c9-6bbd-4462-81ae-3b1692a06d4a already deleted. [ 668.860667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7eac1c9-6bbd-4462-81ae-3b1692a06d4a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.875194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.875194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.875194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.875194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.875194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.875194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.875194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.875194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.875645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.875645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.875645] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.875645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.875795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.875795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.875991] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.876093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.876093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.876239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.876318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.876405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.876498] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.979756] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.169322] env[66854]: INFO networking_nsxv3.common.synchronization [req-cce22b51-b26e-4c33-aa6a-78f5e3d5b4b4 req-9333c577-ef0d-4fd5-a912-d1c8bbe0cdaf tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGHEST for action security_group_members [ 669.169505] env[66854]: INFO networking_nsxv3.common.synchronization [req-cce22b51-b26e-4c33-aa6a-78f5e3d5b4b4 req-9333c577-ef0d-4fd5-a912-d1c8bbe0cdaf tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 669.169631] env[66854]: INFO networking_nsxv3.common.synchronization [req-cce22b51-b26e-4c33-aa6a-78f5e3d5b4b4 req-9333c577-ef0d-4fd5-a912-d1c8bbe0cdaf tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_members [ 669.171041] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGHEST for action security_group_members [ 669.171185] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 669.171289] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_members [ 669.171577] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.171696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.171762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.172088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.172428] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.172428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.172428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.173406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.173406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.173406] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.177992] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.177992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.177992] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.177992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.197022] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82708b01-13e8-453a-8492-93929a99b850 in Status: SUCCESS [ 669.197022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.197022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.197022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.197022] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.197022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.197022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.197022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.197632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.197632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.197632] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.236531] env[66854]: INFO networking_nsxv3.common.synchronization [req-cce22b51-b26e-4c33-aa6a-78f5e3d5b4b4 req-9333c577-ef0d-4fd5-a912-d1c8bbe0cdaf tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_rules [ 669.238021] env[66854]: INFO networking_nsxv3.common.synchronization [req-cce22b51-b26e-4c33-aa6a-78f5e3d5b4b4 req-9333c577-ef0d-4fd5-a912-d1c8bbe0cdaf tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_members [ 669.238021] env[66854]: INFO networking_nsxv3.common.synchronization [req-cce22b51-b26e-4c33-aa6a-78f5e3d5b4b4 req-9333c577-ef0d-4fd5-a912-d1c8bbe0cdaf tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 669.238021] env[66854]: INFO networking_nsxv3.common.synchronization [req-cce22b51-b26e-4c33-aa6a-78f5e3d5b4b4 req-9333c577-ef0d-4fd5-a912-d1c8bbe0cdaf tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 669.238021] env[66854]: INFO networking_nsxv3.common.synchronization [req-cce22b51-b26e-4c33-aa6a-78f5e3d5b4b4 req-9333c577-ef0d-4fd5-a912-d1c8bbe0cdaf tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGHEST for action security_group_rules [ 669.238021] env[66854]: INFO networking_nsxv3.common.synchronization [req-cce22b51-b26e-4c33-aa6a-78f5e3d5b4b4 req-9333c577-ef0d-4fd5-a912-d1c8bbe0cdaf tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGHEST for action security_group_members [ 669.238021] env[66854]: INFO networking_nsxv3.common.synchronization [req-cce22b51-b26e-4c33-aa6a-78f5e3d5b4b4 req-9333c577-ef0d-4fd5-a912-d1c8bbe0cdaf tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 8475678a-6dc0-420e-8764-60089d7359b9 with Priority: HIGHEST for action port [ 669.238948] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_rules [ 669.239218] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 669.239423] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGHEST for action security_group_members [ 669.242020] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8475678a-6dc0-420e-8764-60089d7359b9 with Priority: HIGHEST for action port [ 669.242020] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGHEST for action security_group_rules [ 669.242020] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_members [ 669.242020] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 669.242020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.242020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.242020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.242020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.242020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.242020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.242020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8475678a-6dc0-420e-8764-60089d7359b9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.242020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.242020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.242020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.242020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8475678a-6dc0-420e-8764-60089d7359b9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.244337] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.245340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.247429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.247429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.247429] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.247429] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.247429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.247429] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.248244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.379284] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b68d89c-9278-4047-a0c4-e471d31223ed: rpc.has_security_group_logging(os_id): False [ 669.399315] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.399495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.400398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.400398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.400398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.400398] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.400398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.400398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.400767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.400767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.400829] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.401084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.401084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.401401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.401563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.401808] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.401975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.402079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.402447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.402447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.402447] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b68d89c-9278-4047-a0c4-e471d31223ed is going to be updated. [ 669.424245] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 669.424936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.425305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.425557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.426076] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.426498] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.426498] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.426614] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.426651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.426771] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.478774] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.478944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.479032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.479758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.479758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.486241] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.486392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.486449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.486677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.486763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.486861] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be created. [ 669.493629] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: IN_PROGRESS for 2s [ 669.513357] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.513618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.513746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.513971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.514236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.524675] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: UNINITIALIZED for 2s [ 669.677805] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.700663] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.750599] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8475678a-6dc0-420e-8764-60089d7359b9 with status ACTIVE [ 669.750599] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.750740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.750775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.751809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.751809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.751809] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.751809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.751809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.751809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.752418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.752418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.752593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.752593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.752699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.752758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.752811] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8475678a-6dc0-420e-8764-60089d7359b9 is going to be updated. [ 669.754121] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.754319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.778330] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.778490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.778568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.778794] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.779093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.779180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8475678a-6dc0-420e-8764-60089d7359b9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.929277] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.929509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.929619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.929918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.930131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.930383] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.930507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.930589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.930790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.930913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.931072] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 669.975713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.975713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.975713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.976221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.976221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.990773] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 670.115284] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 670.115284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.115756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.115756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.115949] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.116053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.116150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.116401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.116537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.116656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.116784] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.118782] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: SUCCESS [ 670.119080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.119335] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.119587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.119806] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.119942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.120035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.120190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.120273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.120367] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.121135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.121322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.121457] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.121562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.121773] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.121926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.122013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.122259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.122375] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.123368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.123531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.124017] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.124127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.124182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.124341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.124423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.124510] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.184216] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.204342] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82708b01-13e8-453a-8492-93929a99b850: rpc.has_security_group_logging(os_id): False [ 670.230936] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.230936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.230936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.230936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.230936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.230936] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.230936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.230936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.230936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.230936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.230936] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82708b01-13e8-453a-8492-93929a99b850 is going to be created. [ 670.342705] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.342973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.342973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.343224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.343442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.370491] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82708b01-13e8-453a-8492-93929a99b850 in Status: IN_PROGRESS for 2s [ 670.625115] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.626438] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.626691] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.627116] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.628071] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.686022] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.686249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.686295] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.688020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.688020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.688020] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd is going to be created. [ 670.718552] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.718803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.718937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.719219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.719503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.743990] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd in Status: UNINITIALIZED for 2s [ 670.863418] env[66854]: INFO networking_nsxv3.common.synchronization [req-28aa0b82-b139-4259-aca9-daf9a6ffe9ab req-8f1f0726-fbd5-4be0-84ec-22681bd92181 tempest-VolumesAdminNegativeTest-152066289 tempest-VolumesAdminNegativeTest-152066289-project-member] Enqueued Resource ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff with Priority: HIGHEST for action security_group_members [ 670.863418] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff with Priority: HIGHEST for action security_group_members [ 670.863418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.863418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.863418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.863418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.863418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.863418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.863418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.864282] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.864282] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.864282] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e79fde6-a444-40c2-9d78-9932f7d7c5ff',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.128180] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.130053] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 522304fc-ecb3-47d1-844c-54013760964c: rpc.has_security_group_logging(os_id): False [ 671.133110] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.159943] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.160245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.160245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.160453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.160769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.160905] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.160905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.161045] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.161153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.161253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.161347] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 522304fc-ecb3-47d1-844c-54013760964c is going to be created. [ 671.245655] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.246049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.246049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.246372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.246560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.269690] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: IN_PROGRESS for 2s [ 671.367024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.367535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.367650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.368014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.368167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.368423] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.368509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.368700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.368771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.368899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.369133] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff already deleted. [ 671.369239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.513886] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: SUCCESS [ 671.514474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.537945] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 671.538176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.538344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.538587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.538805] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.538957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.539084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.539228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.539420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.539420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.539511] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.631820] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.632077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.632237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.632540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.632660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.632881] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 671.638735] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.638735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.638735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.638735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.638974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.638974] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522304fc-ecb3-47d1-844c-54013760964c is going to be updated. [ 671.675597] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.675761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.675830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.676076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.676256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.678680] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.679110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.679110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.679308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.679453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.700499] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: IN_PROGRESS for 2s [ 671.700499] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 672.005554] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 672.005554] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a deletion is rescheduled due to dependency. [ 672.005710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.005839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.006245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.006245] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.006489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.006489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.010255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.010255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.010255] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.043343] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.043615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.043615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.043925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.044211] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.044366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.044448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.044657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.044753] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.044850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.045267] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.045430] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.045430] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.045765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.045765] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.045765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.046018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.046018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.049357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.049545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.049636] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.165709] env[66854]: INFO networking_nsxv3.common.synchronization [None req-766e9e47-c638-4f02-8601-bd3e47025ec4 None None] Enqueued Resource ID: c39eb088-de55-4571-b5ca-b340b461939a with Priority: HIGHEST for action port [ 672.166511] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c39eb088-de55-4571-b5ca-b340b461939a with Priority: HIGHEST for action port [ 672.166961] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c39eb088-de55-4571-b5ca-b340b461939a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.167285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c39eb088-de55-4571-b5ca-b340b461939a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.167394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c39eb088-de55-4571-b5ca-b340b461939a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.167768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c39eb088-de55-4571-b5ca-b340b461939a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.167942] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c39eb088-de55-4571-b5ca-b340b461939a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.236695] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.236908] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-493" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.237141] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-493" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.237440] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-493" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.237717] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.237875] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.237984] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.240109] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.240276] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.243062] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.243437] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.243571] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.243685] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.243805] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.243912] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.244242] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.289013] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.289013] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.289233] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.289477] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-493" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.289804] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-e353e87a-e2ec-4a22-8be0-50081a1a3343 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.290020] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-e353e87a-e2ec-4a22-8be0-50081a1a3343" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.290148] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-e353e87a-e2ec-4a22-8be0-50081a1a3343" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.290557] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-e353e87a-e2ec-4a22-8be0-50081a1a3343" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.290720] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e353e87a-e2ec-4a22-8be0-50081a1a3343',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.386651] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82708b01-13e8-453a-8492-93929a99b850 in Status: SUCCESS [ 672.386887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.512225] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.512225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.512342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.512519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.512610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.512826] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.512928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.512991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.513306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.513306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.513763] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 672.546728] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.547077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.547077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.547233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.547412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.552436] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 404f4fa4-39e5-44f2-b930-0c5f5853142c: rpc.has_security_group_logging(os_id): False [ 672.558205] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 672.570739] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.570970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.571067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.571269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.571350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.571541] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.571637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.571698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.571861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.571941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.572161] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.572260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.572323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.572465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.572543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.572738] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.572830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.572892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.573048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.573125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.573212] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be created. [ 672.638054] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.638054] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.638054] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.638054] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.638054] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.649075] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 672.672197] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c39eb088-de55-4571-b5ca-b340b461939a [ 672.672348] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.672479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.672538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.672754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.672840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.672963] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c39eb088-de55-4571-b5ca-b340b461939a already deleted. [ 672.673071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c39eb088-de55-4571-b5ca-b340b461939a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.753525] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd in Status: SUCCESS [ 672.754123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.754368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.754601] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.754795] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.754910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.754977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.755185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.755269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.755374] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.795440] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.795440] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.795440] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.795440] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.795440] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.795440] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port e353e87a-e2ec-4a22-8be0-50081a1a3343 not found, creating... [ 672.795440] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.795817] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.795817] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.796228] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.796228] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.796648] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.796902] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.797130] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.797457] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.797730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.797965] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: e353e87a-e2ec-4a22-8be0-50081a1a3343 is going to be created. [ 672.835279] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.835279] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.835789] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.835789] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.835875] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.836285] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-e353e87a-e2ec-4a22-8be0-50081a1a3343" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.261031] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.283146] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: SUCCESS [ 673.283372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.283600] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.283836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.284144] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.556668] env[66854]: INFO networking_nsxv3.common.synchronization [req-28aa0b82-b139-4259-aca9-daf9a6ffe9ab req-9f7b74a9-d410-44f9-a4d6-f1c50467bae7 service nova] Enqueued Resource ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff with Priority: HIGHEST for action security_group_rules [ 673.557479] env[66854]: INFO networking_nsxv3.common.synchronization [req-28aa0b82-b139-4259-aca9-daf9a6ffe9ab req-9f7b74a9-d410-44f9-a4d6-f1c50467bae7 service nova] Enqueued Resource ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff with Priority: HIGHEST for action security_group_members [ 673.557649] env[66854]: INFO networking_nsxv3.common.synchronization [req-28aa0b82-b139-4259-aca9-daf9a6ffe9ab req-9f7b74a9-d410-44f9-a4d6-f1c50467bae7 service nova] Enqueued Resource ID: e353e87a-e2ec-4a22-8be0-50081a1a3343 with Priority: HIGHEST for action port [ 673.558243] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff with Priority: HIGHEST for action security_group_rules [ 673.558405] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff with Priority: HIGHEST for action security_group_members [ 673.558527] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e353e87a-e2ec-4a22-8be0-50081a1a3343 with Priority: HIGHEST for action port [ 673.561352] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e79fde6-a444-40c2-9d78-9932f7d7c5ff taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.561352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.561352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.561352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.561352] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e79fde6-a444-40c2-9d78-9932f7d7c5ff',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.566630] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.566807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.566807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.567019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.567176] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.567276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.567366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.567483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.567567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.567662] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e79fde6-a444-40c2-9d78-9932f7d7c5ff',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.568520] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e353e87a-e2ec-4a22-8be0-50081a1a3343 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.568645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e353e87a-e2ec-4a22-8be0-50081a1a3343" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.568696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e353e87a-e2ec-4a22-8be0-50081a1a3343" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.569616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e353e87a-e2ec-4a22-8be0-50081a1a3343" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.569616] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e353e87a-e2ec-4a22-8be0-50081a1a3343',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.716023] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 673.716023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.716023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.716023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.716023] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.716023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.716023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.716023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.716023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.716023] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.720095] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: SUCCESS [ 673.720346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.721195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.721195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.721377] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.721523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.721621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.721851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.721955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.723388] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.763697] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.787259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.787423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.877630] env[66854]: INFO networking_nsxv3.common.synchronization [None req-c7b3bc4b-2cc4-444c-bcaa-3e47acef1218 None None] Enqueued Resource ID: 16afa25b-968a-4349-a5aa-524fb58f8d10 with Priority: HIGHEST for action port [ 673.878597] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16afa25b-968a-4349-a5aa-524fb58f8d10 with Priority: HIGHEST for action port [ 673.878597] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-16afa25b-968a-4349-a5aa-524fb58f8d10 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.878597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16afa25b-968a-4349-a5aa-524fb58f8d10" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.878933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16afa25b-968a-4349-a5aa-524fb58f8d10" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.878973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16afa25b-968a-4349-a5aa-524fb58f8d10" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.880264] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16afa25b-968a-4349-a5aa-524fb58f8d10',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.916780] env[66854]: INFO networking_nsxv3.common.synchronization [None req-c8e297f2-6658-43e7-862f-4be8ebd8dede None None] Enqueued Resource ID: 4a95662d-6248-467c-befd-4dbbf46b8988 with Priority: HIGHEST for action port [ 673.917344] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a95662d-6248-467c-befd-4dbbf46b8988 with Priority: HIGHEST for action port [ 673.917648] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a95662d-6248-467c-befd-4dbbf46b8988 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.917766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a95662d-6248-467c-befd-4dbbf46b8988" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.917843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a95662d-6248-467c-befd-4dbbf46b8988" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.918188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a95662d-6248-467c-befd-4dbbf46b8988" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.918276] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a95662d-6248-467c-befd-4dbbf46b8988',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.070315] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e79fde6-a444-40c2-9d78-9932f7d7c5ff',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.072733] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.072958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.073784] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e353e87a-e2ec-4a22-8be0-50081a1a3343 with status ACTIVE [ 674.074268] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.074488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.074603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.075287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.075287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.075471] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.075471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.075624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.075675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.075731] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.075915] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.076017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.076079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.076221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.076299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.076433] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e353e87a-e2ec-4a22-8be0-50081a1a3343 is going to be updated. [ 674.103935] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.104280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.104280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.104469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.104657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.104775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e353e87a-e2ec-4a22-8be0-50081a1a3343" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.221438] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.228927] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.267778] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.267778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.267778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.267778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.267778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.267778] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd is going to be updated. [ 674.301111] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.301111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.301111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.301111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.301111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.314590] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd in Status: IN_PROGRESS for 2s [ 674.386743] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16afa25b-968a-4349-a5aa-524fb58f8d10 [ 674.386743] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.386743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.386743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.386743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.386743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.386743] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16afa25b-968a-4349-a5aa-524fb58f8d10 already deleted. [ 674.386743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16afa25b-968a-4349-a5aa-524fb58f8d10" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.421247] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a95662d-6248-467c-befd-4dbbf46b8988 [ 674.422076] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.422076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.422076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.422076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.422076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.422393] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a95662d-6248-467c-befd-4dbbf46b8988 already deleted. [ 674.422393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a95662d-6248-467c-befd-4dbbf46b8988" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.571242] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 674.571242] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a deletion is rescheduled due to dependency. [ 674.571242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.579212] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e79fde6-a444-40c2-9d78-9932f7d7c5ff',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.662968] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 674.663216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.727330] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.730306] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.079396] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.080427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.080427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.080427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.080427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.080854] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff is going to be created. [ 675.113394] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.113394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.113394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.113394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.113601] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.126712] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff in Status: UNINITIALIZED for 2s [ 675.226526] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.226697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.226937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.230369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.230486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.230608] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 675.233726] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.233925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.237198] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.237464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.237593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.237708] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522304fc-ecb3-47d1-844c-54013760964c is going to be updated. [ 675.279192] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.279192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.279192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.279192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.279192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.285706] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.285858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.285903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.287311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.287311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.289061] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: IN_PROGRESS for 2s [ 675.295927] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 676.341696] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd in Status: SUCCESS [ 676.342111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.342111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.342238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.342733] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.342733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.342733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.342983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.342983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.342983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.343202] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.846660] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.141043] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff in Status: SUCCESS [ 677.141043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.141310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.141436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.141646] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.141774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.141841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.142063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.143519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.143519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.143519] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e79fde6-a444-40c2-9d78-9932f7d7c5ff',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.303071] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: SUCCESS [ 677.303321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.303555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.303991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.303991] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.304310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.304310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.304525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.304525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.304735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.304735] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.308119] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 677.308119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.308119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.308119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.309192] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.309354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.309422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.309663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.309759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.309857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.310087] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.310225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.310300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.310466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.310614] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.310858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.310858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.310973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.311072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.311161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.311258] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.348321] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd: rpc.has_security_group_logging(os_id): False [ 677.376197] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.376362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.376421] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.378922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.378922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.378922] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.378922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.378922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.378922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.378922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.378922] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd is going to be created. [ 677.456040] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.456040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.456040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.456040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.456040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.470703] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e9487f35-2ca8-481d-b1b3-88da9a09cb81 None None] Enqueued Resource ID: bc9141b0-4f10-444e-ac84-0f56213d8b5a with Priority: HIGHEST for action port [ 677.473179] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd in Status: IN_PROGRESS for 2s [ 677.474042] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9141b0-4f10-444e-ac84-0f56213d8b5a with Priority: HIGHEST for action port [ 677.474610] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc9141b0-4f10-444e-ac84-0f56213d8b5a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.475076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc9141b0-4f10-444e-ac84-0f56213d8b5a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.475278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc9141b0-4f10-444e-ac84-0f56213d8b5a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.476274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc9141b0-4f10-444e-ac84-0f56213d8b5a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.476274] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc9141b0-4f10-444e-ac84-0f56213d8b5a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.646324] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.646544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.646544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.646825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.646930] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.647064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.647122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.647270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.647359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.647482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.647673] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.647759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.647801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.647924] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.648073] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.648172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.648231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.648370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.648446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.648534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.648621] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e79fde6-a444-40c2-9d78-9932f7d7c5ff',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.813716] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.820242] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87b57f10-d9c1-422b-ae4f-428ffd202f74: rpc.has_security_group_logging(os_id): False [ 677.841330] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.841553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.841623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.841844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.841916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.842140] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.842329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.842329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.842470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.842549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.842834] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.843118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.843199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.843453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.843453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.844789] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.844789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.844789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.844789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.844789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.844789] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 677.920409] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.920573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.920955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.920955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.920955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.940127] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 677.979804] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc9141b0-4f10-444e-ac84-0f56213d8b5a [ 677.980199] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.980507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.980583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.981219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.981441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.981653] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc9141b0-4f10-444e-ac84-0f56213d8b5a already deleted. [ 677.982031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc9141b0-4f10-444e-ac84-0f56213d8b5a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.155241] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e79fde6-a444-40c2-9d78-9932f7d7c5ff: rpc.has_security_group_logging(os_id): False [ 678.172966] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.173154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.173200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.173421] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.173516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.173708] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.173805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.173870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.174029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.174144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.174347] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.174450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.174538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.174681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.174762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.174960] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.178086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.178205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.178287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.178373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.178469] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff is going to be created. [ 678.246708] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.246884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.246957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.247181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.247368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.260559] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff in Status: IN_PROGRESS for 2s [ 678.318367] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 522304fc-ecb3-47d1-844c-54013760964c: rpc.has_security_group_logging(os_id): False [ 678.365952] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.366327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.366327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.366520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.366520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.366732] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.366866] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.366904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.367052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.367124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.367214] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 522304fc-ecb3-47d1-844c-54013760964c is going to be updated. [ 678.438174] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.438310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.438387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.438603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.438749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.460519] env[66854]: INFO networking_nsxv3.common.synchronization [req-6ef3d4a2-af4c-4f8c-9218-17a1a8b4cf90 req-f2b4cc13-0336-45da-9b1e-35cd883719a3 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 678.463987] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: IN_PROGRESS for 2s [ 678.463987] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 678.463987] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.463987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.465158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.465158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.465158] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.465507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.465507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.467030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.467030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.467030] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.971324] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.971901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.971901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.971901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.972136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.972239] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.972610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.972610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.972610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.972758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.972806] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 679.009212] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.009212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.009212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.009212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.009212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.020660] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 679.487313] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd in Status: SUCCESS [ 679.487751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.968720] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 679.969574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.969574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.969907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.970045] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.273529] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff in Status: SUCCESS [ 680.273529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.476556] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: SUCCESS [ 680.476816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.477203] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.477383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.477478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.477682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.477851] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.477951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.478126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.478171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.478251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.479247] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.479383] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.982307] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.982640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.982684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.982926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.983151] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.983269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.983357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.983541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.983659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.983778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.983967] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.984147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.984215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.984415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.984579] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.984697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.984859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.984948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.985051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.985154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.985284] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.032146] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 681.032234] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 deletion is rescheduled due to dependency. [ 681.032356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.487629] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87b57f10-d9c1-422b-ae4f-428ffd202f74: rpc.has_security_group_logging(os_id): False [ 681.507277] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.507495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.507555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.507772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.507834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.508029] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.508126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.508229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.508376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.508461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.508688] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.508798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.508858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.509026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.509176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.509321] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.509475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.509536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.509703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.509781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.509868] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 681.526359] env[66854]: INFO networking_nsxv3.common.synchronization [req-ff1efe0d-3a94-4986-a49c-8f1091463d32 req-81141b41-8624-4720-8d62-8bc16c304283 tempest-ServersAdminTestJSON-1278843131 tempest-ServersAdminTestJSON-1278843131-project-member] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 681.527311] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 681.527311] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.527311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.527311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.529725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.530344] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.530480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.530549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.530698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.530796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.531058] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.573691] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.573853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.573903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.574325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.574446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.589192] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 682.034075] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.234416] env[66854]: INFO networking_nsxv3.common.synchronization [None req-bf3bb2a0-8ff5-4b3e-aee0-5c810591b0de None None] Enqueued Resource ID: 18dd1fd5-b261-44bf-9a27-eb18b7d7a65b with Priority: HIGHEST for action port [ 682.235462] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18dd1fd5-b261-44bf-9a27-eb18b7d7a65b with Priority: HIGHEST for action port [ 682.235793] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-18dd1fd5-b261-44bf-9a27-eb18b7d7a65b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.235988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18dd1fd5-b261-44bf-9a27-eb18b7d7a65b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.236248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18dd1fd5-b261-44bf-9a27-eb18b7d7a65b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.236548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18dd1fd5-b261-44bf-9a27-eb18b7d7a65b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.236639] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18dd1fd5-b261-44bf-9a27-eb18b7d7a65b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.538853] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.739964] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18dd1fd5-b261-44bf-9a27-eb18b7d7a65b [ 682.744023] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.744023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.744023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.744023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.744023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.744023] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18dd1fd5-b261-44bf-9a27-eb18b7d7a65b already deleted. [ 682.744023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18dd1fd5-b261-44bf-9a27-eb18b7d7a65b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.869041] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.869041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.869041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.869041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.869041] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.869041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.869041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.869041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.869583] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.869583] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.869583] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.869687] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.870768] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.870768] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.870768] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.870768] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.893546] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.893634] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.893762] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.893949] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.894283] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-d5b3952c-62cd-4979-98b5-93ebf8ab21d6 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.894524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-d5b3952c-62cd-4979-98b5-93ebf8ab21d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.894672] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-d5b3952c-62cd-4979-98b5-93ebf8ab21d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.894952] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-d5b3952c-62cd-4979-98b5-93ebf8ab21d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.895140] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5b3952c-62cd-4979-98b5-93ebf8ab21d6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.934472] env[66854]: INFO networking_nsxv3.common.synchronization [None req-601e90a7-96a8-48cb-a2ba-81342c443378 None None] Enqueued Resource ID: 1121393c-6c83-4460-bb90-574bc673bd74 with Priority: HIGHEST for action port [ 682.935011] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1121393c-6c83-4460-bb90-574bc673bd74 with Priority: HIGHEST for action port [ 682.935333] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-1121393c-6c83-4460-bb90-574bc673bd74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.935972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1121393c-6c83-4460-bb90-574bc673bd74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.935972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1121393c-6c83-4460-bb90-574bc673bd74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.935972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1121393c-6c83-4460-bb90-574bc673bd74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.935972] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1121393c-6c83-4460-bb90-574bc673bd74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.041731] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.042486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.042486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.042486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.042486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.042486] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 683.071329] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.071329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.071329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.072491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.072491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.081698] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 683.399507] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.399769] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.399846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.400171] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.400320] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.400471] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port d5b3952c-62cd-4979-98b5-93ebf8ab21d6 not found, creating... [ 683.400731] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.400885] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.401206] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.401206] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.401340] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.401653] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.401807] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.401916] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.402265] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.402389] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.402634] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: d5b3952c-62cd-4979-98b5-93ebf8ab21d6 is going to be created. [ 683.423166] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.423354] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.423405] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.423680] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.423900] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.424133] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-d5b3952c-62cd-4979-98b5-93ebf8ab21d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.439452] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1121393c-6c83-4460-bb90-574bc673bd74 [ 683.439452] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.439452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.439452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.439452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.439452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.439452] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1121393c-6c83-4460-bb90-574bc673bd74 already deleted. [ 683.439452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1121393c-6c83-4460-bb90-574bc673bd74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.605960] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 683.606187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.169130] env[66854]: INFO networking_nsxv3.common.synchronization [req-ff1efe0d-3a94-4986-a49c-8f1091463d32 req-02f6295d-d2fb-4ad2-ad89-f9bbdeabbec9 service nova] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_rules [ 684.169396] env[66854]: INFO networking_nsxv3.common.synchronization [req-ff1efe0d-3a94-4986-a49c-8f1091463d32 req-02f6295d-d2fb-4ad2-ad89-f9bbdeabbec9 service nova] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 684.169441] env[66854]: INFO networking_nsxv3.common.synchronization [req-ff1efe0d-3a94-4986-a49c-8f1091463d32 req-02f6295d-d2fb-4ad2-ad89-f9bbdeabbec9 service nova] Enqueued Resource ID: d5b3952c-62cd-4979-98b5-93ebf8ab21d6 with Priority: HIGHEST for action port [ 684.169977] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_rules [ 684.170133] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 684.170402] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b3952c-62cd-4979-98b5-93ebf8ab21d6 with Priority: HIGHEST for action port [ 684.172811] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.172811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.172811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.172811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.172811] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.173826] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.173826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.176606] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5b3952c-62cd-4979-98b5-93ebf8ab21d6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.176755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5b3952c-62cd-4979-98b5-93ebf8ab21d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.176755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5b3952c-62cd-4979-98b5-93ebf8ab21d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.177649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5b3952c-62cd-4979-98b5-93ebf8ab21d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.177649] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5b3952c-62cd-4979-98b5-93ebf8ab21d6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.606651] env[66854]: INFO networking_nsxv3.common.synchronization [None req-b2b292c8-9b94-4dec-84a7-352e0c0aa6be None None] Enqueued Resource ID: 75ca68fe-7d26-4168-bedd-fca757406299 with Priority: HIGHEST for action port [ 684.606651] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ca68fe-7d26-4168-bedd-fca757406299 with Priority: HIGHEST for action port [ 684.606651] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-75ca68fe-7d26-4168-bedd-fca757406299 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.606651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75ca68fe-7d26-4168-bedd-fca757406299" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.606651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75ca68fe-7d26-4168-bedd-fca757406299" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.606651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75ca68fe-7d26-4168-bedd-fca757406299" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.606651] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75ca68fe-7d26-4168-bedd-fca757406299',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.681318] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.681318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.681486] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5b3952c-62cd-4979-98b5-93ebf8ab21d6 with status ACTIVE [ 684.681663] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.681769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.681835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.682059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.682239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.682334] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.682433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.682674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.682732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.682786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.682972] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.683505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.683505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.683505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.683505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.683505] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5b3952c-62cd-4979-98b5-93ebf8ab21d6 is going to be updated. [ 684.708487] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.708732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.708732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.709503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.709503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.709503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5b3952c-62cd-4979-98b5-93ebf8ab21d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.967670] env[66854]: INFO networking_nsxv3.common.synchronization [None req-afe6c16b-4f61-4102-89c0-e074b369b15b None None] Enqueued Resource ID: 39f82653-ced5-4d46-ad58-0f0e23082bed with Priority: HIGHEST for action port [ 684.969583] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f82653-ced5-4d46-ad58-0f0e23082bed with Priority: HIGHEST for action port [ 684.969908] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-39f82653-ced5-4d46-ad58-0f0e23082bed taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.970052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39f82653-ced5-4d46-ad58-0f0e23082bed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.970142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39f82653-ced5-4d46-ad58-0f0e23082bed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.970421] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39f82653-ced5-4d46-ad58-0f0e23082bed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.970515] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39f82653-ced5-4d46-ad58-0f0e23082bed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.095736] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 685.096659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.096911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.097187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.098049] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.098220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.098440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.098561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.098623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.098734] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.108806] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75ca68fe-7d26-4168-bedd-fca757406299 [ 685.109075] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.109185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.109227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.109436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.109528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.109819] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75ca68fe-7d26-4168-bedd-fca757406299 already deleted. [ 685.109906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75ca68fe-7d26-4168-bedd-fca757406299" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.475725] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39f82653-ced5-4d46-ad58-0f0e23082bed [ 685.475725] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.476248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.476248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.476248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.476248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.476248] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39f82653-ced5-4d46-ad58-0f0e23082bed already deleted. [ 685.476495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39f82653-ced5-4d46-ad58-0f0e23082bed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.603311] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.794049] env[66854]: INFO networking_nsxv3.common.synchronization [req-96260072-7c1a-45c4-8b59-60858fad2445 req-998586f0-d739-450a-8899-05653ac3ebf6 tempest-DeleteServersAdminTestJSON-1100910551 tempest-DeleteServersAdminTestJSON-1100910551-project-member] Enqueued Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 685.795260] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 685.795601] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.795725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.795804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.795985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.796161] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.796260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.796319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.796465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.796543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.796642] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.105807] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.256535] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.256535] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.256535] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.256535] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.256884] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.257187] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.257187] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.257318] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.257390] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.257605] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.257683] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.257786] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.257885] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.258285] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.258285] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.258285] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.277439] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.277598] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.277732] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.277901] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.278231] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-cc6e6c68-b45b-4498-8ca0-c701182c883f taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.278393] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-cc6e6c68-b45b-4498-8ca0-c701182c883f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.278508] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-cc6e6c68-b45b-4498-8ca0-c701182c883f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.278814] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-cc6e6c68-b45b-4498-8ca0-c701182c883f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.278945] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc6e6c68-b45b-4498-8ca0-c701182c883f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.301153] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.301334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.301467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.301627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.301737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.301960] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.302101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.302165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.302365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.302451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.302741] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 is going to be updated. [ 686.331198] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.331431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.331478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.331821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.331821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.343566] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: IN_PROGRESS for 2s [ 686.611194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.611194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.611194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.611789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.611789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.611789] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 686.646624] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.646835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.646988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.647308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.648030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.661858] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 686.780879] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.781836] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.781836] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.781836] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.781836] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.782058] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port cc6e6c68-b45b-4498-8ca0-c701182c883f not found, creating... [ 686.782217] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.782331] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.782464] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.782665] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.782898] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.783093] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.783252] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.783743] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.783743] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.783743] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.783869] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: cc6e6c68-b45b-4498-8ca0-c701182c883f is going to be created. [ 686.807493] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.807672] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.808820] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.808820] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.808820] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.808820] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-cc6e6c68-b45b-4498-8ca0-c701182c883f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.332262] env[66854]: INFO networking_nsxv3.common.synchronization [None req-959ded58-ff25-4971-be0a-62a7853ef99d None None] Enqueued Resource ID: 008db130-bfba-48b7-b224-1ea496d0d39f with Priority: HIGHEST for action port [ 687.332262] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008db130-bfba-48b7-b224-1ea496d0d39f with Priority: HIGHEST for action port [ 687.332262] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-008db130-bfba-48b7-b224-1ea496d0d39f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.332262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-008db130-bfba-48b7-b224-1ea496d0d39f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.332262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-008db130-bfba-48b7-b224-1ea496d0d39f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.332262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-008db130-bfba-48b7-b224-1ea496d0d39f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.332262] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('008db130-bfba-48b7-b224-1ea496d0d39f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.523285] env[66854]: INFO networking_nsxv3.common.synchronization [req-96260072-7c1a-45c4-8b59-60858fad2445 req-4b34b6cd-462e-471d-beb9-c8a83b7a694a service nova] Enqueued Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_rules [ 687.523406] env[66854]: INFO networking_nsxv3.common.synchronization [req-96260072-7c1a-45c4-8b59-60858fad2445 req-4b34b6cd-462e-471d-beb9-c8a83b7a694a service nova] Enqueued Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 687.524030] env[66854]: INFO networking_nsxv3.common.synchronization [req-96260072-7c1a-45c4-8b59-60858fad2445 req-4b34b6cd-462e-471d-beb9-c8a83b7a694a service nova] Enqueued Resource ID: cc6e6c68-b45b-4498-8ca0-c701182c883f with Priority: HIGHEST for action port [ 687.524248] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_rules [ 687.524351] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 687.524583] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6e6c68-b45b-4498-8ca0-c701182c883f with Priority: HIGHEST for action port [ 687.524895] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.525035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.525155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.525307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.525390] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.526318] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.526417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.526614] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc6e6c68-b45b-4498-8ca0-c701182c883f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.526715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc6e6c68-b45b-4498-8ca0-c701182c883f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.526823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc6e6c68-b45b-4498-8ca0-c701182c883f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.527058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc6e6c68-b45b-4498-8ca0-c701182c883f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.527184] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc6e6c68-b45b-4498-8ca0-c701182c883f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.838916] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 008db130-bfba-48b7-b224-1ea496d0d39f [ 687.839398] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.839398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.839568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.839693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.839783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.839933] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:008db130-bfba-48b7-b224-1ea496d0d39f already deleted. [ 687.839978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-008db130-bfba-48b7-b224-1ea496d0d39f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.028875] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.029062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.029219] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc6e6c68-b45b-4498-8ca0-c701182c883f with status ACTIVE [ 688.029389] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.029499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.029634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.029788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.029875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.030079] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.030174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.030230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.030448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.030527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.030713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.030806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.030899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.031020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.031092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.031178] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc6e6c68-b45b-4498-8ca0-c701182c883f is going to be updated. [ 688.058926] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.059124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.059195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.059409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.059624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.061814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc6e6c68-b45b-4498-8ca0-c701182c883f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.362755] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: SUCCESS [ 688.362755] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 deletion is rescheduled due to dependency. [ 688.362755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.362755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.362755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.363274] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.363274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.363274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.363786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.363786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.363786] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.675049] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 688.675049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.675049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.675255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.675385] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.675475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.675932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.675932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.675932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.675932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.676117] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.869077] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.179367] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.179566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.179566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.179828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.179951] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.180058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.180121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.180265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.180347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.180429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.180575] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.181447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.181545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.181730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.181895] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.181989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.182068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.182213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.182294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.182380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.182472] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.372143] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.687390] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 404f4fa4-39e5-44f2-b930-0c5f5853142c: rpc.has_security_group_logging(os_id): False [ 689.704678] env[66854]: INFO networking_nsxv3.common.synchronization [req-c6eb607b-4ba8-4e93-ade8-df47a4a938a4 req-bbfc7477-270b-4841-866c-73df490ea14a tempest-ServersWithSpecificFlavorTestJSON-1363282919 tempest-ServersWithSpecificFlavorTestJSON-1363282919-project-member] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 689.705276] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 689.705583] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.705727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.705795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.707543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.707790] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.708658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.708658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.708658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.708658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.708658] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.710764] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.710764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.710764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.710764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.710764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.710764] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.710764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.710764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.711246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.711246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.713559] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.713559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.713559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.713559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.713559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.713559] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.713559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.713559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.713559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.713559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.713559] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 689.782168] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.782628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.782860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.783955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.784062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.798163] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 689.878023] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.878023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.878023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.878023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.878023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.878023] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 is going to be updated. [ 689.945111] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.945326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.945326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.945729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.945729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.959981] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: IN_PROGRESS for 2s [ 690.037870] env[66854]: INFO networking_nsxv3.common.synchronization [None req-daa57bac-557f-42ad-af4e-30c54b8f7acc None None] Enqueued Resource ID: f4da0b74-0a62-442b-8129-eb5c31e27e11 with Priority: HIGHEST for action port [ 690.040692] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4da0b74-0a62-442b-8129-eb5c31e27e11 with Priority: HIGHEST for action port [ 690.040692] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4da0b74-0a62-442b-8129-eb5c31e27e11 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.040692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4da0b74-0a62-442b-8129-eb5c31e27e11" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.040692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4da0b74-0a62-442b-8129-eb5c31e27e11" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.040692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4da0b74-0a62-442b-8129-eb5c31e27e11" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.040692] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4da0b74-0a62-442b-8129-eb5c31e27e11',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.224408] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.224408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.224408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.224408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.224408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.224408] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.224408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.224408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.224408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.224408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.224408] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e already deleted. [ 690.224408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.253019] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-443 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.253019] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.253019] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.253019] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.253019] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.253019] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.253019] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.253639] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.253967] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.254395] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.254687] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.254928] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.255170] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.255385] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.255587] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.257270] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.281455] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.281659] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 690.281826] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.282029] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.282350] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-c4006258-a5f2-4d95-b8da-633b964be65e taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.282748] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-c4006258-a5f2-4d95-b8da-633b964be65e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.282748] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-c4006258-a5f2-4d95-b8da-633b964be65e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.283018] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-c4006258-a5f2-4d95-b8da-633b964be65e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.283196] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4006258-a5f2-4d95-b8da-633b964be65e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.542403] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4da0b74-0a62-442b-8129-eb5c31e27e11 [ 690.542718] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.542985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.543120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.544034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.544034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.544034] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4da0b74-0a62-442b-8129-eb5c31e27e11 already deleted. [ 690.544034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4da0b74-0a62-442b-8129-eb5c31e27e11" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.785581] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.785900] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.786148] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.786687] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.786788] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.787030] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port c4006258-a5f2-4d95-b8da-633b964be65e not found, creating... [ 690.787748] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.787882] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.787924] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.788402] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.789494] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.789494] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.789494] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.789494] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.789832] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.790797] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.790797] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: c4006258-a5f2-4d95-b8da-633b964be65e is going to be created. [ 690.940863] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.941302] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.941302] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.941520] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.941931] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.942048] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-c4006258-a5f2-4d95-b8da-633b964be65e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.086054] env[66854]: INFO networking_nsxv3.common.synchronization [None req-9c5ef540-1c67-49a5-8c45-1ad32a8c2908 tempest-AttachVolumeTestJSON-1641278713 tempest-AttachVolumeTestJSON-1641278713-project-member] Enqueued Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_rules [ 691.086658] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_rules [ 691.086981] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.087318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.087318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.087446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.087539] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.382363] env[66854]: INFO networking_nsxv3.common.synchronization [None req-ea0bc86b-2aaa-4287-8aa6-bf1374722a8f tempest-AttachVolumeTestJSON-1641278713 tempest-AttachVolumeTestJSON-1641278713-project-member] Enqueued Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_rules [ 691.383124] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_rules [ 691.383950] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.384068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.599240] env[66854]: INFO networking_nsxv3.common.synchronization [req-c6eb607b-4ba8-4e93-ade8-df47a4a938a4 req-4180ca14-675b-4b7e-af5b-e8b4153278fb service nova] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_rules [ 691.599240] env[66854]: INFO networking_nsxv3.common.synchronization [req-c6eb607b-4ba8-4e93-ade8-df47a4a938a4 req-4180ca14-675b-4b7e-af5b-e8b4153278fb service nova] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 691.599240] env[66854]: INFO networking_nsxv3.common.synchronization [req-c6eb607b-4ba8-4e93-ade8-df47a4a938a4 req-4180ca14-675b-4b7e-af5b-e8b4153278fb service nova] Enqueued Resource ID: c4006258-a5f2-4d95-b8da-633b964be65e with Priority: HIGHEST for action port [ 691.599240] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_rules [ 691.599240] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 691.599240] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4006258-a5f2-4d95-b8da-633b964be65e with Priority: HIGHEST for action port [ 691.600071] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.600176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.600419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.600593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.600593] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.603329] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.603329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.603329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.603329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.603329] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.603329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.603734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.603734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.603734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.603734] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.604542] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4006258-a5f2-4d95-b8da-633b964be65e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.604703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4006258-a5f2-4d95-b8da-633b964be65e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.604758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4006258-a5f2-4d95-b8da-633b964be65e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.608031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4006258-a5f2-4d95-b8da-633b964be65e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.608031] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4006258-a5f2-4d95-b8da-633b964be65e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.611618] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.611618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.611618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.611820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.611820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.611941] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 already deleted. [ 691.611941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.612928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.613760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.613760] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.813476] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 691.813741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.891081] env[66854]: INFO networking_nsxv3.common.synchronization [req-60057ab5-8769-4dba-a826-cc1801d3e3db req-a2200ab3-d860-4bc7-882f-519b44d23f0b tempest-ServerMetadataTestJSON-1744485191 tempest-ServerMetadataTestJSON-1744485191-project-member] Enqueued Resource ID: 28446920-c13b-4dfc-87e9-c9f98af2604c with Priority: HIGHEST for action security_group_members [ 691.891645] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28446920-c13b-4dfc-87e9-c9f98af2604c with Priority: HIGHEST for action security_group_members [ 691.892139] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28446920-c13b-4dfc-87e9-c9f98af2604c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.892340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.892569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.893290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.893290] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.893290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.893482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.893517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.893702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.893885] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28446920-c13b-4dfc-87e9-c9f98af2604c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.970814] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: SUCCESS [ 691.971209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.971740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.971979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.972225] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.972368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.972489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.972645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.972744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.972836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.972984] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.102728] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.102954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.106415] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.107424] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4006258-a5f2-4d95-b8da-633b964be65e with status ACTIVE [ 692.107622] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.107757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.107828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.108071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.108162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.108343] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.108455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.108517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.108689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.108767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.108966] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.109064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.109140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.109279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.109352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.109436] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4006258-a5f2-4d95-b8da-633b964be65e is going to be updated. [ 692.147525] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.147757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.147757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.147984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.148105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.148212] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 already deleted. [ 692.148299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.150010] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.150214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.150214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.150376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.150517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.150681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4006258-a5f2-4d95-b8da-633b964be65e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.396655] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.396804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.396877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.397295] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.397390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.397594] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.397721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.397801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.397970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.398128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.398276] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28446920-c13b-4dfc-87e9-c9f98af2604c already deleted. [ 692.398368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.476480] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.476480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.476480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.477265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.477265] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.477265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.477265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.477265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.477493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.477493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.477574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.477679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.477768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.477915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.478091] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.478188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.478266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.478406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.478477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.478579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.478687] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.511297] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-236 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.511512] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-236" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.511601] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-236" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.511925] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-236" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.512197] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.512347] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.512458] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.512672] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.512812] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.513017] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.513128] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.513230] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.513331] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.513435] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.513531] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.513654] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.533691] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.533882] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 692.533992] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.534190] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-236" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.534609] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-ffe4bc48-842d-4b97-9034-3d6a174047f7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.534810] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-ffe4bc48-842d-4b97-9034-3d6a174047f7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.534927] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-ffe4bc48-842d-4b97-9034-3d6a174047f7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.536303] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-ffe4bc48-842d-4b97-9034-3d6a174047f7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.536451] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffe4bc48-842d-4b97-9034-3d6a174047f7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.612022] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.980507] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882c622e-5e75-4cbc-a5f9-518be75e1bd0: rpc.has_security_group_logging(os_id): False [ 692.999251] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.999516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.999516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.999720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.999823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.000221] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.000221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.000342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.000424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.000497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.000737] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.000862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.000945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.001555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.001555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.001555] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.001555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.001555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.001840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.001840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.001920] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 is going to be updated. [ 693.040206] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.040622] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.040837] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.041296] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.041541] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.041724] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port ffe4bc48-842d-4b97-9034-3d6a174047f7 not found, creating... [ 693.042168] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.042302] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.042361] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.042590] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.042721] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.043036] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.043226] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.043405] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.043719] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.043921] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.044148] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: ffe4bc48-842d-4b97-9034-3d6a174047f7 is going to be created. [ 693.066080] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.066339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.066465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.066814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.067080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.073788] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.074150] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.074362] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.074729] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.075011] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.075314] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-ffe4bc48-842d-4b97-9034-3d6a174047f7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.082658] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: IN_PROGRESS for 2s [ 693.114282] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.114479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.114553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.114870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.114973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.115105] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e is going to be created. [ 693.143858] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.144117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.144117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.144280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.144454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.158600] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: UNINITIALIZED for 2s [ 693.805685] env[66854]: INFO networking_nsxv3.common.synchronization [req-60057ab5-8769-4dba-a826-cc1801d3e3db req-275b6afc-863f-40f1-a38d-cae975100bdf service nova] Enqueued Resource ID: 28446920-c13b-4dfc-87e9-c9f98af2604c with Priority: HIGHEST for action security_group_rules [ 693.805919] env[66854]: INFO networking_nsxv3.common.synchronization [req-60057ab5-8769-4dba-a826-cc1801d3e3db req-275b6afc-863f-40f1-a38d-cae975100bdf service nova] Enqueued Resource ID: 28446920-c13b-4dfc-87e9-c9f98af2604c with Priority: HIGHEST for action security_group_members [ 693.806440] env[66854]: INFO networking_nsxv3.common.synchronization [req-60057ab5-8769-4dba-a826-cc1801d3e3db req-275b6afc-863f-40f1-a38d-cae975100bdf service nova] Enqueued Resource ID: ffe4bc48-842d-4b97-9034-3d6a174047f7 with Priority: HIGHEST for action port [ 693.807033] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28446920-c13b-4dfc-87e9-c9f98af2604c with Priority: HIGHEST for action security_group_rules [ 693.808630] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28446920-c13b-4dfc-87e9-c9f98af2604c with Priority: HIGHEST for action security_group_members [ 693.808630] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe4bc48-842d-4b97-9034-3d6a174047f7 with Priority: HIGHEST for action port [ 693.808630] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28446920-c13b-4dfc-87e9-c9f98af2604c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.808630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.808630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.808630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.809449] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28446920-c13b-4dfc-87e9-c9f98af2604c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.810289] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28446920-c13b-4dfc-87e9-c9f98af2604c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.811073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.811073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.811073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.811073] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.811073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.811073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.812178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.812178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.812178] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28446920-c13b-4dfc-87e9-c9f98af2604c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.812693] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffe4bc48-842d-4b97-9034-3d6a174047f7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.812693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffe4bc48-842d-4b97-9034-3d6a174047f7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.812811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffe4bc48-842d-4b97-9034-3d6a174047f7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.813755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffe4bc48-842d-4b97-9034-3d6a174047f7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.813755] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffe4bc48-842d-4b97-9034-3d6a174047f7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.237700] env[66854]: INFO networking_nsxv3.common.synchronization [None req-dfb22923-488f-44ff-bbad-118421dbf2d8 None None] Enqueued Resource ID: 41c8bd5a-e198-4563-aa5f-c5f2e1d25995 with Priority: HIGHEST for action port [ 694.238108] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c8bd5a-e198-4563-aa5f-c5f2e1d25995 with Priority: HIGHEST for action port [ 694.238426] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-41c8bd5a-e198-4563-aa5f-c5f2e1d25995 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.238581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41c8bd5a-e198-4563-aa5f-c5f2e1d25995" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.238730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41c8bd5a-e198-4563-aa5f-c5f2e1d25995" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.238893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41c8bd5a-e198-4563-aa5f-c5f2e1d25995" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.238975] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41c8bd5a-e198-4563-aa5f-c5f2e1d25995',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.316374] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28446920-c13b-4dfc-87e9-c9f98af2604c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.316511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.316859] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28446920-c13b-4dfc-87e9-c9f98af2604c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.317910] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffe4bc48-842d-4b97-9034-3d6a174047f7 with status ACTIVE [ 694.318180] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.318336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.318389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.318636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.318755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.319009] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.319452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.320549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.320549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.320549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.320549] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.320769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.320917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.321833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.321833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.322054] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffe4bc48-842d-4b97-9034-3d6a174047f7 is going to be updated. [ 694.346228] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.346381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.346454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.346666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.346805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.346964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffe4bc48-842d-4b97-9034-3d6a174047f7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.747371] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41c8bd5a-e198-4563-aa5f-c5f2e1d25995 [ 694.747371] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.747371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.747371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.747565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.747565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.747651] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41c8bd5a-e198-4563-aa5f-c5f2e1d25995 already deleted. [ 694.747743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41c8bd5a-e198-4563-aa5f-c5f2e1d25995" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.825137] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28446920-c13b-4dfc-87e9-c9f98af2604c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.100471] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: SUCCESS [ 695.101026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.170092] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: SUCCESS [ 695.170316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.170495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.170720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.170920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.171071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.171141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.171400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.171400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.171513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.171596] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.327167] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.327551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.327551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.327807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.328182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.328182] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28446920-c13b-4dfc-87e9-c9f98af2604c is going to be created. [ 695.354770] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.355076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.355404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.355404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.358022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.367957] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28446920-c13b-4dfc-87e9-c9f98af2604c in Status: UNINITIALIZED for 2s [ 695.675233] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.177917] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0fd45c4-bc5d-47a2-a08d-dfba578f269e: rpc.has_security_group_logging(os_id): False [ 696.198450] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.198626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.198703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.198908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.199017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.199293] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.199402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.199518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.199740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.199740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.199890] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e is going to be created. [ 696.268118] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.268337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.268489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.268769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.269560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.287191] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: IN_PROGRESS for 2s [ 697.385028] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28446920-c13b-4dfc-87e9-c9f98af2604c in Status: SUCCESS [ 697.385442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.385442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.385647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.385859] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.386038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.386126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.386285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.386378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.387212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.387344] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28446920-c13b-4dfc-87e9-c9f98af2604c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.890152] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28446920-c13b-4dfc-87e9-c9f98af2604c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.890358] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.890445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.890710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.890916] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.891063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.891148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.891323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.891428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.891523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.891670] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28446920-c13b-4dfc-87e9-c9f98af2604c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.891765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.891822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.891964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.892129] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.892251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.892319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.892479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.892559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.892643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.892732] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28446920-c13b-4dfc-87e9-c9f98af2604c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.304160] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: SUCCESS [ 698.304460] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.396571] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28446920-c13b-4dfc-87e9-c9f98af2604c: rpc.has_security_group_logging(os_id): False [ 698.420313] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.420313] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.420313] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.420313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.420957] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.420957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.420957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.420957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.420957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.420957] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28446920-c13b-4dfc-87e9-c9f98af2604c is going to be created. [ 698.486780] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.487018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.487122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.487281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.487461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.503071] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28446920-c13b-4dfc-87e9-c9f98af2604c in Status: IN_PROGRESS for 2s [ 698.918021] env[66854]: INFO networking_nsxv3.common.synchronization [None req-4d25ab15-562e-4270-bdf7-1e64207e5031 None None] Enqueued Resource ID: f74400e9-dc63-46cb-8ded-f82627a3cf60 with Priority: HIGHEST for action port [ 698.918021] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f74400e9-dc63-46cb-8ded-f82627a3cf60 with Priority: HIGHEST for action port [ 698.918021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f74400e9-dc63-46cb-8ded-f82627a3cf60 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.918614] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f74400e9-dc63-46cb-8ded-f82627a3cf60" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.918870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f74400e9-dc63-46cb-8ded-f82627a3cf60" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.919269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f74400e9-dc63-46cb-8ded-f82627a3cf60" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.919462] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f74400e9-dc63-46cb-8ded-f82627a3cf60',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.311022] env[66854]: INFO networking_nsxv3.common.synchronization [req-9af99fde-bb2f-4cea-80e3-fa7cbef0f2ec req-87ddf656-a0f0-478c-868a-5605518a1fdf tempest-SecurityGroupRulesTestJSON-1101102742 tempest-SecurityGroupRulesTestJSON-1101102742-project-member] Enqueued Resource ID: 1fdc323c-768f-4cb8-8580-d4901d64c1d6 with Priority: HIGHEST for action security_group_rules [ 699.311022] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdc323c-768f-4cb8-8580-d4901d64c1d6 with Priority: HIGHEST for action security_group_rules [ 699.312103] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fdc323c-768f-4cb8-8580-d4901d64c1d6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.312103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fdc323c-768f-4cb8-8580-d4901d64c1d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.312103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fdc323c-768f-4cb8-8580-d4901d64c1d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.312624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fdc323c-768f-4cb8-8580-d4901d64c1d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.312689] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fdc323c-768f-4cb8-8580-d4901d64c1d6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.426526] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f74400e9-dc63-46cb-8ded-f82627a3cf60 [ 699.427064] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.427157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.427300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.427640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.427786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.427971] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f74400e9-dc63-46cb-8ded-f82627a3cf60 already deleted. [ 699.428167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f74400e9-dc63-46cb-8ded-f82627a3cf60" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.836327] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.836484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.836585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.836837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.836990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.837140] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fdc323c-768f-4cb8-8580-d4901d64c1d6 already deleted. [ 699.837209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fdc323c-768f-4cb8-8580-d4901d64c1d6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.520086] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28446920-c13b-4dfc-87e9-c9f98af2604c in Status: SUCCESS [ 700.520086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.292284] env[66854]: INFO networking_nsxv3.common.synchronization [req-47d07a57-1959-4095-8178-45696ebbb6fe req-5d98a056-5c26-4d13-9648-d608bb3541da tempest-VolumesAdminNegativeTest-152066289 tempest-VolumesAdminNegativeTest-152066289-project-member] Enqueued Resource ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff with Priority: HIGHEST for action security_group_members [ 701.292961] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff with Priority: HIGHEST for action security_group_members [ 701.293325] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.293489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.293543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.293733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.293894] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.293993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.294069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.294247] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.294313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.295102] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e79fde6-a444-40c2-9d78-9932f7d7c5ff',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.423617] env[66854]: INFO networking_nsxv3.common.synchronization [req-ab634ce0-4e25-4060-a275-df068a788380 req-9bc9d581-5a85-473a-b298-8c94210289da tempest-FloatingIPsAssociationNegativeTestJSON-1849276530 tempest-FloatingIPsAssociationNegativeTestJSON-1849276530-project-member] Enqueued Resource ID: 57f39420-06ae-4013-a107-2dab8327c1d0 with Priority: HIGHEST for action security_group_members [ 701.424234] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f39420-06ae-4013-a107-2dab8327c1d0 with Priority: HIGHEST for action security_group_members [ 701.424560] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f39420-06ae-4013-a107-2dab8327c1d0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.424683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.424759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.425063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.425230] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.425334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.425397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.425557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.425658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.425764] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57f39420-06ae-4013-a107-2dab8327c1d0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.800472] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.800472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.800472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.800472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.800472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.800472] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.800472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.800472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.800472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.800472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.800472] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff is going to be updated. [ 701.806031] env[66854]: INFO networking_nsxv3.common.synchronization [req-87491469-beb5-455c-a33a-f37785350f5a req-be64690b-f8a6-4071-9a5d-11775a221ac7 tempest-FloatingIPsAssociationTestJSON-1643548393 tempest-FloatingIPsAssociationTestJSON-1643548393-project-member] Enqueued Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 701.806513] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 701.806948] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.809203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.809203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.809203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.809203] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.809203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.809203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.809203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.809203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.809203] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.831659] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.831791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.831859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.832212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.832482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.844756] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff in Status: IN_PROGRESS for 2s [ 701.929356] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.929356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.929356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.929356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.929356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.929356] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.929356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.929356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.929356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.929356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.929356] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f39420-06ae-4013-a107-2dab8327c1d0 already deleted. [ 701.929356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.310181] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.392960] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.394085] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-591" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.394085] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-591" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.394085] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-591" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.394393] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.394847] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.394847] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.394972] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.395047] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.395271] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.395374] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.395674] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.395674] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.395794] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.395862] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.396131] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.438582] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.438759] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 702.438895] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.439091] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-591" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.439451] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-2e3212e4-1c5a-4e13-87c6-584821ea4fd8 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.439634] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-2e3212e4-1c5a-4e13-87c6-584821ea4fd8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.439751] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-2e3212e4-1c5a-4e13-87c6-584821ea4fd8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.440102] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-2e3212e4-1c5a-4e13-87c6-584821ea4fd8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.440256] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e3212e4-1c5a-4e13-87c6-584821ea4fd8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.812752] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.942728] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.942952] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.943101] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.943447] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.943530] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.943680] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 2e3212e4-1c5a-4e13-87c6-584821ea4fd8 not found, creating... [ 702.943933] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.944098] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.944213] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.944417] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.944547] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.944816] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.944962] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.945110] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.945322] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.945459] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.945595] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 2e3212e4-1c5a-4e13-87c6-584821ea4fd8 is going to be created. [ 702.967756] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.968165] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.968165] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.968446] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.968703] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.968955] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-2e3212e4-1c5a-4e13-87c6-584821ea4fd8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.106480] env[66854]: INFO networking_nsxv3.common.synchronization [None req-cf711926-6e1d-4d75-96f5-1c603a4e472f None None] Enqueued Resource ID: 905ceb6f-21c2-4b4d-8c2b-f321b61f4cb3 with Priority: HIGHEST for action port [ 703.107099] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905ceb6f-21c2-4b4d-8c2b-f321b61f4cb3 with Priority: HIGHEST for action port [ 703.107533] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-905ceb6f-21c2-4b4d-8c2b-f321b61f4cb3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.107610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-905ceb6f-21c2-4b4d-8c2b-f321b61f4cb3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.107651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-905ceb6f-21c2-4b4d-8c2b-f321b61f4cb3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.108626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-905ceb6f-21c2-4b4d-8c2b-f321b61f4cb3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.108626] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('905ceb6f-21c2-4b4d-8c2b-f321b61f4cb3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.315565] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.315763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.315763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.316076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.316076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.316258] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b68d89c-9278-4047-a0c4-e471d31223ed is going to be updated. [ 703.352170] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.352313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.352362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.352550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.352697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.363568] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: IN_PROGRESS for 2s [ 703.610571] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 905ceb6f-21c2-4b4d-8c2b-f321b61f4cb3 [ 703.612133] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.612133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.612133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.612133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.612133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.612133] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:905ceb6f-21c2-4b4d-8c2b-f321b61f4cb3 already deleted. [ 703.612133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-905ceb6f-21c2-4b4d-8c2b-f321b61f4cb3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.722141] env[66854]: INFO networking_nsxv3.common.synchronization [req-ab634ce0-4e25-4060-a275-df068a788380 req-6b7a5098-1f95-4fc7-9253-3965dfd2b90d service nova] Enqueued Resource ID: 57f39420-06ae-4013-a107-2dab8327c1d0 with Priority: HIGHEST for action security_group_rules [ 703.722141] env[66854]: INFO networking_nsxv3.common.synchronization [req-ab634ce0-4e25-4060-a275-df068a788380 req-6b7a5098-1f95-4fc7-9253-3965dfd2b90d service nova] Enqueued Resource ID: 57f39420-06ae-4013-a107-2dab8327c1d0 with Priority: HIGHEST for action security_group_members [ 703.722141] env[66854]: INFO networking_nsxv3.common.synchronization [req-ab634ce0-4e25-4060-a275-df068a788380 req-6b7a5098-1f95-4fc7-9253-3965dfd2b90d service nova] Enqueued Resource ID: 2e3212e4-1c5a-4e13-87c6-584821ea4fd8 with Priority: HIGHEST for action port [ 703.722664] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f39420-06ae-4013-a107-2dab8327c1d0 with Priority: HIGHEST for action security_group_rules [ 703.722802] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f39420-06ae-4013-a107-2dab8327c1d0 with Priority: HIGHEST for action security_group_members [ 703.722923] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3212e4-1c5a-4e13-87c6-584821ea4fd8 with Priority: HIGHEST for action port [ 703.723264] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57f39420-06ae-4013-a107-2dab8327c1d0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.723398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.723481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.723716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.723802] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57f39420-06ae-4013-a107-2dab8327c1d0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.724686] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f39420-06ae-4013-a107-2dab8327c1d0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.724802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.724867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.725077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.725215] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.725312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.725366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.725513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.725598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.725693] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57f39420-06ae-4013-a107-2dab8327c1d0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.729290] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e3212e4-1c5a-4e13-87c6-584821ea4fd8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.729290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e3212e4-1c5a-4e13-87c6-584821ea4fd8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.729290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e3212e4-1c5a-4e13-87c6-584821ea4fd8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.729290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e3212e4-1c5a-4e13-87c6-584821ea4fd8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.729290] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e3212e4-1c5a-4e13-87c6-584821ea4fd8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.858945] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff in Status: SUCCESS [ 703.858945] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff deletion is rescheduled due to dependency. [ 703.858945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.158186] env[66854]: INFO networking_nsxv3.common.synchronization [req-7312b75f-0e01-48fb-851a-53b3500bad04 req-816cec3c-1e4b-46da-83bc-19a93265e5ab tempest-MultipleCreateTestJSON-768742875 tempest-MultipleCreateTestJSON-768742875-project-member] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 704.158653] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 704.159230] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.159648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.159648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.159768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.160189] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.160189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.160329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.160388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.160505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.160610] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.228854] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57f39420-06ae-4013-a107-2dab8327c1d0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.230207] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f39420-06ae-4013-a107-2dab8327c1d0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.230339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.235978] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e3212e4-1c5a-4e13-87c6-584821ea4fd8 with status ACTIVE [ 704.235978] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.235978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.235978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.235978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.235978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.235978] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.236292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.236292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.236292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.236391] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.238638] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.238638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.238638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.238638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.238638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.238638] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e3212e4-1c5a-4e13-87c6-584821ea4fd8 is going to be updated. [ 704.262899] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.262899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.263207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.263333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.263701] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.264457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e3212e4-1c5a-4e13-87c6-584821ea4fd8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.663856] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.664160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.664160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.665188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.665188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.665188] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.665188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.665188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.665188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.665457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.665457] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 704.694321] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.694512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.694559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.694977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.695398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.709418] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 704.731962] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57f39420-06ae-4013-a107-2dab8327c1d0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.756689] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.756689] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.756689] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.756689] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.756689] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.756957] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.756957] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.757479] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.758045] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.759934] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.759934] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.759934] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.759934] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.759934] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.759934] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.759934] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.781342] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.781342] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.781342] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.781342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.781342] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-8e392dd8-05b5-46c4-ac35-57181f530de8 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.781342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-8e392dd8-05b5-46c4-ac35-57181f530de8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.781342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-8e392dd8-05b5-46c4-ac35-57181f530de8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.781342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-8e392dd8-05b5-46c4-ac35-57181f530de8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.781686] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e392dd8-05b5-46c4-ac35-57181f530de8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.234636] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.234965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.234965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.235381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.235575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.235732] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f39420-06ae-4013-a107-2dab8327c1d0 is going to be created. [ 705.260492] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.260672] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.260763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.261184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.261941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.276777] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f39420-06ae-4013-a107-2dab8327c1d0 in Status: UNINITIALIZED for 2s [ 705.284915] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.284915] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.284915] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.284915] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.285297] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.285399] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 8e392dd8-05b5-46c4-ac35-57181f530de8 not found, creating... [ 705.285739] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.285896] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.286028] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.286325] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.286486] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.286962] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.287129] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.287244] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.287578] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.287729] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.287940] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 8e392dd8-05b5-46c4-ac35-57181f530de8 is going to be created. [ 705.312017] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.312307] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.312459] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.312773] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.312996] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.313301] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-8e392dd8-05b5-46c4-ac35-57181f530de8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.375894] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: SUCCESS [ 705.376320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.732832] env[66854]: INFO networking_nsxv3.common.synchronization [req-7312b75f-0e01-48fb-851a-53b3500bad04 req-1fcd2975-c2c5-4a8e-8116-d8e5dfe38fd0 tempest-MultipleCreateTestJSON-768742875 tempest-MultipleCreateTestJSON-768742875-project-member] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 705.733349] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 705.733919] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.734033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.085973] env[66854]: INFO networking_nsxv3.common.synchronization [req-7312b75f-0e01-48fb-851a-53b3500bad04 req-a49745aa-fe56-436a-a339-1f090f11fa70 service nova] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_rules [ 706.086060] env[66854]: INFO networking_nsxv3.common.synchronization [req-7312b75f-0e01-48fb-851a-53b3500bad04 req-a49745aa-fe56-436a-a339-1f090f11fa70 service nova] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 706.086249] env[66854]: INFO networking_nsxv3.common.synchronization [req-7312b75f-0e01-48fb-851a-53b3500bad04 req-a49745aa-fe56-436a-a339-1f090f11fa70 service nova] Enqueued Resource ID: 8e392dd8-05b5-46c4-ac35-57181f530de8 with Priority: HIGHEST for action port [ 706.087047] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_rules [ 706.087047] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 706.087702] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e392dd8-05b5-46c4-ac35-57181f530de8 with Priority: HIGHEST for action port [ 706.088253] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.088253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.088387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.089585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.089585] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.090757] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.090757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.090757] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e392dd8-05b5-46c4-ac35-57181f530de8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.090757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e392dd8-05b5-46c4-ac35-57181f530de8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.091262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e392dd8-05b5-46c4-ac35-57181f530de8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.091262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e392dd8-05b5-46c4-ac35-57181f530de8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.091262] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e392dd8-05b5-46c4-ac35-57181f530de8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.124132] env[66854]: INFO networking_nsxv3.common.synchronization [None req-0e1b32bf-56dd-47df-b951-44790088819a None None] Enqueued Resource ID: 41a82c45-8d87-41a8-bc5f-12dcd558ebd1 with Priority: HIGHEST for action port [ 706.125438] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41a82c45-8d87-41a8-bc5f-12dcd558ebd1 with Priority: HIGHEST for action port [ 706.125438] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-41a82c45-8d87-41a8-bc5f-12dcd558ebd1 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.125438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41a82c45-8d87-41a8-bc5f-12dcd558ebd1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.125599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41a82c45-8d87-41a8-bc5f-12dcd558ebd1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.125784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41a82c45-8d87-41a8-bc5f-12dcd558ebd1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.125869] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41a82c45-8d87-41a8-bc5f-12dcd558ebd1',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.410103] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.410527] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.410527] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.410954] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.411379] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.411560] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.411762] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.411927] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.412088] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.412290] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.412407] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.412953] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.412953] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.412953] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.412953] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.412953] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.436481] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.436817] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 706.436914] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.437155] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-355" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.437534] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-77b984b5-7e31-42d4-acc8-0d81a1b83d55 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.437743] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-77b984b5-7e31-42d4-acc8-0d81a1b83d55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.437821] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-77b984b5-7e31-42d4-acc8-0d81a1b83d55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.438135] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-77b984b5-7e31-42d4-acc8-0d81a1b83d55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.438272] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77b984b5-7e31-42d4-acc8-0d81a1b83d55',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.591499] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.591702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.593016] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e392dd8-05b5-46c4-ac35-57181f530de8 with status ACTIVE [ 706.593239] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.593366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.593430] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.593795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.593795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.593956] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.594037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.594091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.594255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.594361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.594550] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.594643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.594697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.594901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.594969] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.595063] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e392dd8-05b5-46c4-ac35-57181f530de8 is going to be updated. [ 706.621999] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.621999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.621999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.621999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.621999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.621999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e392dd8-05b5-46c4-ac35-57181f530de8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.627812] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41a82c45-8d87-41a8-bc5f-12dcd558ebd1 [ 706.628318] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.628525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.628525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.629025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.629025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.629025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41a82c45-8d87-41a8-bc5f-12dcd558ebd1 already deleted. [ 706.629391] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41a82c45-8d87-41a8-bc5f-12dcd558ebd1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.722956] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 706.723203] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 deletion is rescheduled due to dependency. [ 706.723344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.723592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.723832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.724039] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.724173] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.724241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.724400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.724481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.724580] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.940533] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.940755] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.940875] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.941181] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.941329] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.941481] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 77b984b5-7e31-42d4-acc8-0d81a1b83d55 not found, creating... [ 706.941755] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.941915] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.942044] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.942259] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.942391] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.942661] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.942814] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.942908] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.943246] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.943396] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.943547] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 77b984b5-7e31-42d4-acc8-0d81a1b83d55 is going to be created. [ 706.964564] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.964728] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.964861] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.965405] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.965486] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.965699] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-77b984b5-7e31-42d4-acc8-0d81a1b83d55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.226728] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.286275] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f39420-06ae-4013-a107-2dab8327c1d0 in Status: SUCCESS [ 707.286537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.286700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.286916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.287129] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.287254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.287352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.287536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.287658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.287754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.287850] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57f39420-06ae-4013-a107-2dab8327c1d0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.697980] env[66854]: INFO networking_nsxv3.common.synchronization [req-7312b75f-0e01-48fb-851a-53b3500bad04 req-3cbf9237-a775-4f7d-b8d5-de86af0f4fd4 service nova] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_rules [ 707.697980] env[66854]: INFO networking_nsxv3.common.synchronization [req-7312b75f-0e01-48fb-851a-53b3500bad04 req-3cbf9237-a775-4f7d-b8d5-de86af0f4fd4 service nova] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 707.697980] env[66854]: INFO networking_nsxv3.common.synchronization [req-7312b75f-0e01-48fb-851a-53b3500bad04 req-3cbf9237-a775-4f7d-b8d5-de86af0f4fd4 service nova] Enqueued Resource ID: 77b984b5-7e31-42d4-acc8-0d81a1b83d55 with Priority: HIGHEST for action port [ 707.697980] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_rules [ 707.705026] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 707.705026] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b984b5-7e31-42d4-acc8-0d81a1b83d55 with Priority: HIGHEST for action port [ 707.705026] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.705026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.705026] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.705026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.705026] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-77b984b5-7e31-42d4-acc8-0d81a1b83d55 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.705026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77b984b5-7e31-42d4-acc8-0d81a1b83d55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.705026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77b984b5-7e31-42d4-acc8-0d81a1b83d55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.705026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77b984b5-7e31-42d4-acc8-0d81a1b83d55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.705026] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77b984b5-7e31-42d4-acc8-0d81a1b83d55',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.728887] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.793035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f39420-06ae-4013-a107-2dab8327c1d0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.793035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.793035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f39420-06ae-4013-a107-2dab8327c1d0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.793035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.793035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.794340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.794340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.794340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.794340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.794340] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57f39420-06ae-4013-a107-2dab8327c1d0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.946663] env[66854]: INFO networking_nsxv3.common.synchronization [None req-91d1ec6b-e215-4d0d-a8ce-0b918cadc060 None None] Enqueued Resource ID: e7b8ea2f-4821-4606-8936-61b07bc705d4 with Priority: HIGHEST for action port [ 707.947266] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8ea2f-4821-4606-8936-61b07bc705d4 with Priority: HIGHEST for action port [ 707.947537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7b8ea2f-4821-4606-8936-61b07bc705d4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.947677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7b8ea2f-4821-4606-8936-61b07bc705d4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.947745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7b8ea2f-4821-4606-8936-61b07bc705d4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.947995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7b8ea2f-4821-4606-8936-61b07bc705d4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.950311] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7b8ea2f-4821-4606-8936-61b07bc705d4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.172603] env[66854]: INFO networking_nsxv3.common.synchronization [req-c49b7116-b696-4a5d-9205-8f1a3d5c4b17 req-3f08420b-3bad-461a-9068-96b5f1983df8 tempest-ImagesNegativeTestJSON-2008465481 tempest-ImagesNegativeTestJSON-2008465481-project-member] Enqueued Resource ID: 92583910-38be-424b-ae0b-e27f87da131b with Priority: HIGHEST for action security_group_members [ 708.173301] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92583910-38be-424b-ae0b-e27f87da131b with Priority: HIGHEST for action security_group_members [ 708.173611] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-92583910-38be-424b-ae0b-e27f87da131b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.173731] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.173792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.174418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.174418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.174418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.174418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.175103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.175195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.175322] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92583910-38be-424b-ae0b-e27f87da131b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.209477] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77b984b5-7e31-42d4-acc8-0d81a1b83d55 with status ACTIVE [ 708.209814] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.210141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.210272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.210516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.210664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.210910] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.211101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.211178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.211657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.211657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.211772] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.211876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.211971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.212195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.212304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.212428] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77b984b5-7e31-42d4-acc8-0d81a1b83d55 is going to be updated. [ 708.231841] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.231914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.231951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.232209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.232338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.232452] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 708.234723] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.234856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.234856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.235157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.235336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.235532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77b984b5-7e31-42d4-acc8-0d81a1b83d55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.264382] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.264559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.264625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.264816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.264948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.281326] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 708.298427] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57f39420-06ae-4013-a107-2dab8327c1d0: rpc.has_security_group_logging(os_id): False [ 708.320052] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.320229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.320281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.320696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.320899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.321079] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.321274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.321341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.321522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.321741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.322055] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.322055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.322055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.322197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.322197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.322421] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.322547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.322547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.322674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.322727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.323276] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57f39420-06ae-4013-a107-2dab8327c1d0 is going to be created. [ 708.408415] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.408619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.408678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.408904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.409231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.422897] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57f39420-06ae-4013-a107-2dab8327c1d0 in Status: IN_PROGRESS for 2s [ 708.454068] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7b8ea2f-4821-4606-8936-61b07bc705d4 [ 708.454269] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.454393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.454466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.454681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.454772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.454871] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7b8ea2f-4821-4606-8936-61b07bc705d4 already deleted. [ 708.454949] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7b8ea2f-4821-4606-8936-61b07bc705d4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.683858] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.683858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.683858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.683858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.683858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.683858] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.683858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.683858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.683858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.683858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.683858] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92583910-38be-424b-ae0b-e27f87da131b already deleted. [ 708.683858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.806624] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-55 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.807095] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.807183] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.807595] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.807854] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.808017] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.808150] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.808731] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.808823] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.809064] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.809800] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.809800] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.809800] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.809800] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.809800] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.811233] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.836026] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.836026] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.836026] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.836026] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-55" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.836379] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-0efdaa8c-eb12-435c-9a1e-3f310810d643 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.836379] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-0efdaa8c-eb12-435c-9a1e-3f310810d643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.836511] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-0efdaa8c-eb12-435c-9a1e-3f310810d643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.836737] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-0efdaa8c-eb12-435c-9a1e-3f310810d643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.836918] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0efdaa8c-eb12-435c-9a1e-3f310810d643',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.342077] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.342867] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.342867] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.342867] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.343208] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.343256] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 0efdaa8c-eb12-435c-9a1e-3f310810d643 not found, creating... [ 709.343797] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.343797] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.343797] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.346194] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.346457] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.346832] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.347031] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.347166] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.347395] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.347531] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.347673] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 0efdaa8c-eb12-435c-9a1e-3f310810d643 is going to be created. [ 709.370096] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.370335] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.370911] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.370911] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.371086] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.371899] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-0efdaa8c-eb12-435c-9a1e-3f310810d643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.131816] env[66854]: INFO networking_nsxv3.common.synchronization [req-c49b7116-b696-4a5d-9205-8f1a3d5c4b17 req-2ba991c4-8854-4a69-bf0a-523575ad3821 service nova] Enqueued Resource ID: 92583910-38be-424b-ae0b-e27f87da131b with Priority: HIGHEST for action security_group_rules [ 710.131816] env[66854]: INFO networking_nsxv3.common.synchronization [req-c49b7116-b696-4a5d-9205-8f1a3d5c4b17 req-2ba991c4-8854-4a69-bf0a-523575ad3821 service nova] Enqueued Resource ID: 92583910-38be-424b-ae0b-e27f87da131b with Priority: HIGHEST for action security_group_members [ 710.131816] env[66854]: INFO networking_nsxv3.common.synchronization [req-c49b7116-b696-4a5d-9205-8f1a3d5c4b17 req-2ba991c4-8854-4a69-bf0a-523575ad3821 service nova] Enqueued Resource ID: 0efdaa8c-eb12-435c-9a1e-3f310810d643 with Priority: HIGHEST for action port [ 710.131816] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92583910-38be-424b-ae0b-e27f87da131b with Priority: HIGHEST for action security_group_rules [ 710.131816] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92583910-38be-424b-ae0b-e27f87da131b with Priority: HIGHEST for action security_group_members [ 710.131816] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0efdaa8c-eb12-435c-9a1e-3f310810d643 with Priority: HIGHEST for action port [ 710.131816] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92583910-38be-424b-ae0b-e27f87da131b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.131816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.131816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.131816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.131816] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92583910-38be-424b-ae0b-e27f87da131b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.133136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-92583910-38be-424b-ae0b-e27f87da131b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.133648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.134113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.134426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.134816] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.135375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.135555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.135853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.136464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.136676] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92583910-38be-424b-ae0b-e27f87da131b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.138349] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-0efdaa8c-eb12-435c-9a1e-3f310810d643 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.138349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0efdaa8c-eb12-435c-9a1e-3f310810d643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.138596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0efdaa8c-eb12-435c-9a1e-3f310810d643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.138757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0efdaa8c-eb12-435c-9a1e-3f310810d643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.139095] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0efdaa8c-eb12-435c-9a1e-3f310810d643',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.144248] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e80c4ed4-1bd2-4e26-9c66-eb8a3629e7ae None None] Enqueued Resource ID: 5cf29bb0-3762-4631-a0af-7d63cf2cae13 with Priority: HIGHEST for action port [ 710.145791] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cf29bb0-3762-4631-a0af-7d63cf2cae13 with Priority: HIGHEST for action port [ 710.145920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cf29bb0-3762-4631-a0af-7d63cf2cae13 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.146779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cf29bb0-3762-4631-a0af-7d63cf2cae13" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.146779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cf29bb0-3762-4631-a0af-7d63cf2cae13" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.146779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cf29bb0-3762-4631-a0af-7d63cf2cae13" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.146779] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cf29bb0-3762-4631-a0af-7d63cf2cae13',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.292306] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 710.292634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.292761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.292908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.293174] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.293174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.293174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.293174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.293865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.293865] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.441922] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57f39420-06ae-4013-a107-2dab8327c1d0 in Status: SUCCESS [ 710.441922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.589698] env[66854]: INFO networking_nsxv3.common.synchronization [None req-df1eb99f-780f-4866-b138-0805741a681d None None] Enqueued Resource ID: 45ede201-89c0-4998-b0cb-d56b2b0bf1eb with Priority: HIGHEST for action port [ 710.590984] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ede201-89c0-4998-b0cb-d56b2b0bf1eb with Priority: HIGHEST for action port [ 710.590984] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-45ede201-89c0-4998-b0cb-d56b2b0bf1eb taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.590984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45ede201-89c0-4998-b0cb-d56b2b0bf1eb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.590984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45ede201-89c0-4998-b0cb-d56b2b0bf1eb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.592165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45ede201-89c0-4998-b0cb-d56b2b0bf1eb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.592165] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ede201-89c0-4998-b0cb-d56b2b0bf1eb',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.650252] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92583910-38be-424b-ae0b-e27f87da131b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.650252] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-92583910-38be-424b-ae0b-e27f87da131b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.650252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.650252] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0efdaa8c-eb12-435c-9a1e-3f310810d643 with status ACTIVE [ 710.650252] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.650252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.650252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.650252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.650252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.650252] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.650252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.650252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.650252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.650252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.653809] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.653809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.653809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.653809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.653809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.653809] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0efdaa8c-eb12-435c-9a1e-3f310810d643 is going to be updated. [ 710.657064] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cf29bb0-3762-4631-a0af-7d63cf2cae13 [ 710.657064] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.657064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.657064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.657064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.657064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.657064] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cf29bb0-3762-4631-a0af-7d63cf2cae13 already deleted. [ 710.657064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cf29bb0-3762-4631-a0af-7d63cf2cae13" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.686670] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.686670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.686670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.686670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.686670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.686670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0efdaa8c-eb12-435c-9a1e-3f310810d643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.798436] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.095655] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45ede201-89c0-4998-b0cb-d56b2b0bf1eb [ 711.095655] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.095795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.095795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.097712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.097863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.097988] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45ede201-89c0-4998-b0cb-d56b2b0bf1eb already deleted. [ 711.098067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45ede201-89c0-4998-b0cb-d56b2b0bf1eb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.160420] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92583910-38be-424b-ae0b-e27f87da131b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.303515] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.667078] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.667078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.667078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.667078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.667078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.667078] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92583910-38be-424b-ae0b-e27f87da131b is going to be created. [ 711.703030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.703030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.703030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.703030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.703030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.713205] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92583910-38be-424b-ae0b-e27f87da131b in Status: UNINITIALIZED for 2s [ 711.806797] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.807018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.807097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.807292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.807378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.807481] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 711.849043] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.849458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.851143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.852201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.852201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.864992] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 711.993120] env[66854]: INFO networking_nsxv3.common.synchronization [req-9a4c5679-a009-470a-837a-5d6574eae9a7 req-78ddb8b8-f741-47b6-a5a6-7adf6370dc6d tempest-SecurityGroupRulesTestJSON-1101102742 tempest-SecurityGroupRulesTestJSON-1101102742-project-member] Enqueued Resource ID: 2f01fb63-4b8e-459b-8a89-a30e04086597 with Priority: HIGHEST for action security_group_rules [ 711.993997] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f01fb63-4b8e-459b-8a89-a30e04086597 with Priority: HIGHEST for action security_group_rules [ 711.996739] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f01fb63-4b8e-459b-8a89-a30e04086597 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.996858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f01fb63-4b8e-459b-8a89-a30e04086597" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.996909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f01fb63-4b8e-459b-8a89-a30e04086597" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.997277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f01fb63-4b8e-459b-8a89-a30e04086597" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.997384] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f01fb63-4b8e-459b-8a89-a30e04086597',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.524123] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.524508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.524508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.524626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.524731] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.524826] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f01fb63-4b8e-459b-8a89-a30e04086597 already deleted. [ 712.524908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f01fb63-4b8e-459b-8a89-a30e04086597" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.946794] env[66854]: INFO networking_nsxv3.common.synchronization [None req-95b52858-de40-482c-a828-ef6247edc30e None None] Enqueued Resource ID: 92c94c28-ec62-4263-88e1-c67d4859d757 with Priority: HIGHEST for action port [ 712.947347] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92c94c28-ec62-4263-88e1-c67d4859d757 with Priority: HIGHEST for action port [ 712.947674] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-92c94c28-ec62-4263-88e1-c67d4859d757 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.947800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92c94c28-ec62-4263-88e1-c67d4859d757" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.947866] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92c94c28-ec62-4263-88e1-c67d4859d757" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.948210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92c94c28-ec62-4263-88e1-c67d4859d757" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.948303] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c94c28-ec62-4263-88e1-c67d4859d757',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.069835] env[66854]: INFO networking_nsxv3.common.synchronization [req-bdb60707-cb06-4e2b-bfe3-fda812d6c550 req-9f636dc5-c2c8-4cab-a39c-cf3da4e76137 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 713.070521] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 713.070521] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.070521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.070693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.070761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.070913] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.071037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.071106] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.071283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.071371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.071472] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.451584] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92c94c28-ec62-4263-88e1-c67d4859d757 [ 713.451584] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.451739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.452457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.452457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.452457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.452457] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92c94c28-ec62-4263-88e1-c67d4859d757 already deleted. [ 713.452457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92c94c28-ec62-4263-88e1-c67d4859d757" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.492476] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e9b5aa46-fc63-4eb1-b2f3-d1e759762534 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_rules [ 713.493108] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_rules [ 713.493369] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.494475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.494475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.494475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.494475] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.547429] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.548056] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.548056] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.548056] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.548370] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.548540] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.548656] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.548882] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.549039] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.549247] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.549353] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.549455] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.549561] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.549666] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.549767] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.549892] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.577188] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.577188] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 713.577188] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.577188] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.577188] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-b4c2fe68-2b9c-42eb-9686-18f646467625 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.577188] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-b4c2fe68-2b9c-42eb-9686-18f646467625" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.577188] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-b4c2fe68-2b9c-42eb-9686-18f646467625" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.577188] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-b4c2fe68-2b9c-42eb-9686-18f646467625" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.577188] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4c2fe68-2b9c-42eb-9686-18f646467625',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.577188] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.578527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.578527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.578527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.578527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.578527] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.578527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.578527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.578527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.578527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.578527] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 713.612028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.612028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.612028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.612028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.612028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.622062] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 713.723566] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92583910-38be-424b-ae0b-e27f87da131b in Status: SUCCESS [ 713.723847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.724119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.724568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.724644] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.724711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.724777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.724940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.725035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.725125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.725229] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92583910-38be-424b-ae0b-e27f87da131b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.767812] env[66854]: INFO networking_nsxv3.common.synchronization [None req-947c8671-07e8-4a6c-8e5e-53eba9c69292 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_rules [ 713.768209] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_rules [ 713.769856] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.769856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.877675] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 713.878179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.878471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.878776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.879085] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.879389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.879547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.879791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.881020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.881020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.881020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.881484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.882272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.882549] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.882795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.883135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.883445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.883624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.883795] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.017270] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.017270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.017270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.017270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.017985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.018144] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 already deleted. [ 714.018510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.018510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.018666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.018714] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.080800] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.083673] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.083673] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.083673] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.083673] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.083673] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port b4c2fe68-2b9c-42eb-9686-18f646467625 not found, creating... [ 714.083673] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.083673] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.083673] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.083673] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.083673] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.083960] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.083960] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.083960] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.083960] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.083960] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.083960] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: b4c2fe68-2b9c-42eb-9686-18f646467625 is going to be created. [ 714.107771] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.108214] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.108214] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.108469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.108691] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.108913] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-b4c2fe68-2b9c-42eb-9686-18f646467625" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.231741] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-92583910-38be-424b-ae0b-e27f87da131b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.232022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.232161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.232558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.232832] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.233027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.233133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.233368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.233850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.233850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.233850] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-92583910-38be-424b-ae0b-e27f87da131b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.233994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.234074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.234283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.234523] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.234655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.234742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.234925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.235040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.235150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.235271] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92583910-38be-424b-ae0b-e27f87da131b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.386143] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.386799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.386799] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.563641] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.564122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.564122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.564122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.564276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.564330] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 already deleted. [ 714.564414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.739339] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92583910-38be-424b-ae0b-e27f87da131b: rpc.has_security_group_logging(os_id): False [ 714.762304] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.762512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.762603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.762832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.762921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.763141] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.763303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.763303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.763456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.763536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.763728] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.763810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.763875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.764035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.764131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.764620] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.764620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.764620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.764821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.764821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.764871] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92583910-38be-424b-ae0b-e27f87da131b is going to be created. [ 714.841700] env[66854]: INFO networking_nsxv3.common.synchronization [req-bdb60707-cb06-4e2b-bfe3-fda812d6c550 req-43ff37e9-8faa-4f8b-af96-407d5c89ff1d service nova] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_rules [ 714.841700] env[66854]: INFO networking_nsxv3.common.synchronization [req-bdb60707-cb06-4e2b-bfe3-fda812d6c550 req-43ff37e9-8faa-4f8b-af96-407d5c89ff1d service nova] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 714.841700] env[66854]: INFO networking_nsxv3.common.synchronization [req-bdb60707-cb06-4e2b-bfe3-fda812d6c550 req-43ff37e9-8faa-4f8b-af96-407d5c89ff1d service nova] Enqueued Resource ID: b4c2fe68-2b9c-42eb-9686-18f646467625 with Priority: HIGHEST for action port [ 714.841700] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_rules [ 714.842340] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 714.842584] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4c2fe68-2b9c-42eb-9686-18f646467625 with Priority: HIGHEST for action port [ 714.847126] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.847126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.847126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.847126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.847126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.847126] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.847126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.847126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.847126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.847126] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.848810] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.849201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.850470] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4c2fe68-2b9c-42eb-9686-18f646467625 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.850470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4c2fe68-2b9c-42eb-9686-18f646467625" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.850470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4c2fe68-2b9c-42eb-9686-18f646467625" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.850470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4c2fe68-2b9c-42eb-9686-18f646467625" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.850470] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4c2fe68-2b9c-42eb-9686-18f646467625',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.867174] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92583910-38be-424b-ae0b-e27f87da131b in Status: IN_PROGRESS for 2s [ 714.890417] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.353662] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.353956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.355242] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4c2fe68-2b9c-42eb-9686-18f646467625 with status ACTIVE [ 715.355389] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.356333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.356333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.356333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.356333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.356333] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.356333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.357074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.357074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.357074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.357074] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.357074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.357074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.357369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.357369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.357643] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4c2fe68-2b9c-42eb-9686-18f646467625 is going to be updated. [ 715.385407] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.385407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.385407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.385407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.385724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.385752] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4c2fe68-2b9c-42eb-9686-18f646467625" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.393799] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.394564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.394564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.394564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.394564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.394564] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 715.474427] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.474884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.474884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.475189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.475468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.492899] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 715.636049] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 715.636049] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 deletion is rescheduled due to dependency. [ 715.636049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.636049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.636049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.636049] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.636049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.636049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.636049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.636049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.636049] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.039294] env[66854]: INFO networking_nsxv3.common.synchronization [req-1fbcdaaf-7cd4-461b-a183-80eaa42c1215 req-9b76efc2-a225-4d15-9aad-e77a3fbec4fd tempest-ServersAdminNegativeTestJSON-44301001 tempest-ServersAdminNegativeTestJSON-44301001-project-member] Enqueued Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 716.039835] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 716.041975] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.042719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.042829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.043379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.043615] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.043736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.043808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.044011] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.044146] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.044259] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.138220] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.514486] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.514678] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.514796] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.515069] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.515362] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.516846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.516846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.516846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.516846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.516846] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.516846] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.516846] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.516846] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.516846] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.516846] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.517144] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.537717] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.539097] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 716.539097] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.539097] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.539097] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-3355be07-bb06-4696-a351-882dbcc0b877 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.539097] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-3355be07-bb06-4696-a351-882dbcc0b877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.539097] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-3355be07-bb06-4696-a351-882dbcc0b877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.539097] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-3355be07-bb06-4696-a351-882dbcc0b877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.539453] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3355be07-bb06-4696-a351-882dbcc0b877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.548967] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.548967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.548967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.548967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.548967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.549195] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.549263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.549297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.549729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.549729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.549729] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e already deleted. [ 716.549729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.640654] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.883029] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92583910-38be-424b-ae0b-e27f87da131b in Status: SUCCESS [ 716.883029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.045591] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.046029] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.046113] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.046960] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.046960] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.046960] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 3355be07-bb06-4696-a351-882dbcc0b877 not found, creating... [ 717.046960] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.047173] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.047254] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.047582] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.047817] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.049018] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.049238] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.049361] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.049991] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.049991] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.049991] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 3355be07-bb06-4696-a351-882dbcc0b877 is going to be created. [ 717.075341] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.075341] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.075440] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.075816] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.076068] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.076341] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-3355be07-bb06-4696-a351-882dbcc0b877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.146407] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.146407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.146407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.146603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.146603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.146727] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 717.225577] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.225812] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.225902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.226328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.226328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.264631] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 717.503525] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 717.503832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.504137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.504422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.504701] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.504918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.505064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.505314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.505463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.505653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.505915] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.506111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.506253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.506456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.506664] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.506921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.507069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.507299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.507494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.507651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.507814] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.841617] env[66854]: INFO networking_nsxv3.common.synchronization [req-1fbcdaaf-7cd4-461b-a183-80eaa42c1215 req-f205a8ae-bcbf-42e0-81d5-5e72f4b86fa0 service nova] Enqueued Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_rules [ 717.841915] env[66854]: INFO networking_nsxv3.common.synchronization [req-1fbcdaaf-7cd4-461b-a183-80eaa42c1215 req-f205a8ae-bcbf-42e0-81d5-5e72f4b86fa0 service nova] Enqueued Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 717.842168] env[66854]: INFO networking_nsxv3.common.synchronization [req-1fbcdaaf-7cd4-461b-a183-80eaa42c1215 req-f205a8ae-bcbf-42e0-81d5-5e72f4b86fa0 service nova] Enqueued Resource ID: 3355be07-bb06-4696-a351-882dbcc0b877 with Priority: HIGHEST for action port [ 717.843681] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_rules [ 717.843862] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 717.846298] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3355be07-bb06-4696-a351-882dbcc0b877 with Priority: HIGHEST for action port [ 717.847228] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.848067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.848229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.848532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.848626] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.849656] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.850136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.850211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.850404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.850565] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.852277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.852277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.852277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.852277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.852277] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.853348] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3355be07-bb06-4696-a351-882dbcc0b877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.853468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3355be07-bb06-4696-a351-882dbcc0b877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.853524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3355be07-bb06-4696-a351-882dbcc0b877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.853705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3355be07-bb06-4696-a351-882dbcc0b877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.853839] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3355be07-bb06-4696-a351-882dbcc0b877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.010387] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1871982-9cf3-4b58-bd63-59badb5546d2: rpc.has_security_group_logging(os_id): False [ 718.032137] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.032301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.032372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.032681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.033100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.033100] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.033253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.033253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.033429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.033490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.033785] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.034365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.034499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.034828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.035120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.035522] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.036104] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.036104] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.036104] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.036104] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.036296] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 718.105631] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.105970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.106138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.107145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.107145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.126524] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 718.129912] env[66854]: INFO networking_nsxv3.common.synchronization [req-b0d6cede-fda4-409f-8881-1f244c482ede req-f5dec198-25f6-4b18-b0cf-591b2307c3eb tempest-DeleteServersAdminTestJSON-1100910551 tempest-DeleteServersAdminTestJSON-1100910551-project-member] Enqueued Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 718.130739] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGHEST for action security_group_members [ 718.131194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.131385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.131490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.131768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.131989] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.132147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.132233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.132444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.132563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.132695] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.355729] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.357838] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.357838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.358224] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3355be07-bb06-4696-a351-882dbcc0b877 with status ACTIVE [ 718.358436] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.359192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.359192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.359192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.359192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.359192] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.359192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.360453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.360453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.360453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.360453] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.360453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.360453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.360453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.360453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.360453] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3355be07-bb06-4696-a351-882dbcc0b877 is going to be updated. [ 718.391023] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.391204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.391280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.391788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.391788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.392029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3355be07-bb06-4696-a351-882dbcc0b877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.636327] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.636580] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.636712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.637154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.637205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.637553] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.637754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.637869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.638164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.638329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.638459] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 is going to be updated. [ 718.681929] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.682130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.682205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.682423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.682608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.695308] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: IN_PROGRESS for 2s [ 718.861159] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.275991] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 719.275991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.275991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.275991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.276287] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.276351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.276384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.277427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.277427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.277427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.277427] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.362734] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.362886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.362955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.363209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.363292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.363391] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e is going to be created. [ 719.394568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.394860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.397590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.397590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.397590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.408332] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: UNINITIALIZED for 2s [ 719.780436] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.780653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.780737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.780979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.781231] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.781303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.781381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.781541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.781626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.781716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.781916] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.781976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.782022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.782174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.782321] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.782414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.782474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.782613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.782696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.782784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.782882] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.117703] env[66854]: INFO networking_nsxv3.common.synchronization [req-457eb5b8-4239-4bc6-a632-cc418e4aaeda req-e4dd3166-3422-444c-aa36-b784d10edd3a tempest-AttachVolumeTestJSON-1641278713 tempest-AttachVolumeTestJSON-1641278713-project-member] Enqueued Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_members [ 720.118374] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_members [ 720.118677] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.118808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.118923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.119623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.119623] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.119623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.119811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.119811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.119878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.119986] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.143691] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 720.144639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.145250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.145529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.145615] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.285661] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ccc5a4-8c8a-445b-b37a-462c691c3639: rpc.has_security_group_logging(os_id): False [ 720.308031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.308201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.308258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.309029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.309029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.309029] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.309029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.309029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.309029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.309257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.309283] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.309506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.309506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.309613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.309648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.309804] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.309974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.309974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.311452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.311452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.311452] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 720.412337] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.412864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.412864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.412952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.413256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.431812] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 720.573021] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-699 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.573021] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-699" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.573021] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-699" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.573021] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-699" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.573431] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.573754] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.574112] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.574595] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.574958] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.575292] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.577602] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.577602] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.577602] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.577602] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.577602] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.577602] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.600593] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.600593] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 720.600593] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.600593] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-699" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.600593] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-ac124198-2897-4b28-8606-63b8c4482304 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.600593] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-ac124198-2897-4b28-8606-63b8c4482304" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.600593] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-ac124198-2897-4b28-8606-63b8c4482304" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.600593] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-ac124198-2897-4b28-8606-63b8c4482304" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.600593] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac124198-2897-4b28-8606-63b8c4482304',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.623453] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.624071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.624071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.624071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.624071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.624234] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.624393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.624436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.624563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.624637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.624738] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 already deleted. [ 720.624798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.650765] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.650765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.650765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.650765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.650765] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.650765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.650765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.650765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.650765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.650765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.650765] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.704718] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 in Status: SUCCESS [ 720.704955] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 deletion is rescheduled due to dependency. [ 720.705090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.102550] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.105380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.105380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.105380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.105380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.105380] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port ac124198-2897-4b28-8606-63b8c4482304 not found, creating... [ 721.105380] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.105380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.105380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.105380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.105380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.105857] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.105857] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.105857] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.105857] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.105857] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.105857] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: ac124198-2897-4b28-8606-63b8c4482304 is going to be created. [ 721.120773] env[66854]: INFO networking_nsxv3.common.synchronization [req-d57418d9-9836-4bb0-94ea-05905b3da760 req-8a325411-4ef6-4b47-bfbd-37347801d633 tempest-SecurityGroupRulesTestJSON-1101102742 tempest-SecurityGroupRulesTestJSON-1101102742-project-member] Enqueued Resource ID: bcfebe9a-cadb-49ff-b142-59a4d22d02b2 with Priority: HIGHEST for action security_group_rules [ 721.121380] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcfebe9a-cadb-49ff-b142-59a4d22d02b2 with Priority: HIGHEST for action security_group_rules [ 721.121676] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcfebe9a-cadb-49ff-b142-59a4d22d02b2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.121795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcfebe9a-cadb-49ff-b142-59a4d22d02b2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.121863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcfebe9a-cadb-49ff-b142-59a4d22d02b2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.122165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcfebe9a-cadb-49ff-b142-59a4d22d02b2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.122267] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcfebe9a-cadb-49ff-b142-59a4d22d02b2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.126373] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.126919] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.126919] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.126919] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.127384] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.127803] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-ac124198-2897-4b28-8606-63b8c4482304" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.153235] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.153541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.153651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.156212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.156212] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.156212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.156650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.156752] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.157116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.157116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.157174] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.157347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.157347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.157507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.158480] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.158480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.158480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.158480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.158480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.158480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.160141] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.419735] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: SUCCESS [ 721.419962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.420151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.420395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.420596] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.420712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.420768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.420922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.421126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.421126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.421185] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.647110] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.647110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.647110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.647110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.647110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.647110] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcfebe9a-cadb-49ff-b142-59a4d22d02b2 already deleted. [ 721.647110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcfebe9a-cadb-49ff-b142-59a4d22d02b2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.663407] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1871982-9cf3-4b58-bd63-59badb5546d2: rpc.has_security_group_logging(os_id): False [ 721.686542] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.686701] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.686787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.686993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.687140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.687387] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.687886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.687886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.687886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.687886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.688062] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.688062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.688141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.688310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.688413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.688590] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.688706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.688747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.688906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.688906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.689068] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 721.758046] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.758046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.758046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.758046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.758336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.774000] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 721.914058] env[66854]: INFO networking_nsxv3.common.synchronization [req-457eb5b8-4239-4bc6-a632-cc418e4aaeda req-2996ddbe-6e99-4b7a-bc3f-e3e878c89766 service nova] Enqueued Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_rules [ 721.914248] env[66854]: INFO networking_nsxv3.common.synchronization [req-457eb5b8-4239-4bc6-a632-cc418e4aaeda req-2996ddbe-6e99-4b7a-bc3f-e3e878c89766 service nova] Enqueued Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_members [ 721.914383] env[66854]: INFO networking_nsxv3.common.synchronization [req-457eb5b8-4239-4bc6-a632-cc418e4aaeda req-2996ddbe-6e99-4b7a-bc3f-e3e878c89766 service nova] Enqueued Resource ID: ac124198-2897-4b28-8606-63b8c4482304 with Priority: HIGHEST for action port [ 721.914936] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_rules [ 721.915092] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_members [ 721.915192] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac124198-2897-4b28-8606-63b8c4482304 with Priority: HIGHEST for action port [ 721.915464] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.915592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.915895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.916284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.916284] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.917314] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.917464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.917558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.917772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.917966] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.918106] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.918188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.918368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.918466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.918583] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.920530] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac124198-2897-4b28-8606-63b8c4482304 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.920641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac124198-2897-4b28-8606-63b8c4482304" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.920735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac124198-2897-4b28-8606-63b8c4482304" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.920935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac124198-2897-4b28-8606-63b8c4482304" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.921086] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac124198-2897-4b28-8606-63b8c4482304',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.923720] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.923920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.923920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.924078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.924253] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.924361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.924424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.924571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.924657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.924743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.924924] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.924977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.925040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.925185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.925348] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.925459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.925543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.925707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.925997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.925997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.925997] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.427025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac124198-2897-4b28-8606-63b8c4482304 with status ACTIVE [ 722.427025] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.427025] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.427025] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.427025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.427025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac124198-2897-4b28-8606-63b8c4482304 is going to be updated. [ 722.428241] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.428241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.428241] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.430172] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b4083ca-5955-4d5e-bfa3-13977c48a75e: rpc.has_security_group_logging(os_id): False [ 722.466787] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.466787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.466787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.466787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.466787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.466787] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.466787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.466787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.466787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.466787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.469113] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.469264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.469307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.469485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.469569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.470837] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.470837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.470837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.470837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.470837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.470837] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e is going to be created. [ 722.474532] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 722.474752] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.479903] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.480080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.480152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.480381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.480520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.480764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac124198-2897-4b28-8606-63b8c4482304" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.605586] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.605817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.605817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.606125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.606312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.619647] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: IN_PROGRESS for 2s [ 722.931183] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.435537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.435977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.436105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.436535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.436535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.436630] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 is going to be created. [ 723.462295] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.462446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.462579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.462728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.462882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.476872] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 in Status: UNINITIALIZED for 2s [ 723.796159] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 723.796402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.981673] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e4b99df4-009a-43ea-8751-22236dd236f7 None None] Enqueued Resource ID: 85b57422-0376-4510-88af-0a9c1e1f579f with Priority: HIGHEST for action port [ 723.982557] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85b57422-0376-4510-88af-0a9c1e1f579f with Priority: HIGHEST for action port [ 723.983543] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-85b57422-0376-4510-88af-0a9c1e1f579f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.983688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85b57422-0376-4510-88af-0a9c1e1f579f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.983864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85b57422-0376-4510-88af-0a9c1e1f579f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.984193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85b57422-0376-4510-88af-0a9c1e1f579f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.985188] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85b57422-0376-4510-88af-0a9c1e1f579f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.487833] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85b57422-0376-4510-88af-0a9c1e1f579f [ 724.487833] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.487833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.487833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.489243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.489243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.489243] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85b57422-0376-4510-88af-0a9c1e1f579f already deleted. [ 724.489243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85b57422-0376-4510-88af-0a9c1e1f579f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.520943] env[66854]: INFO networking_nsxv3.common.synchronization [req-89d6e8a5-6347-4ea8-bb64-d24bdadcd4cc req-816aab3a-12de-4c57-b673-5ae6ea8deea8 tempest-ServersTestMultiNic-36060217 tempest-ServersTestMultiNic-36060217-project-member] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 724.521734] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 724.522166] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.522422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.522575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.522888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.523164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.523373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.523518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.523751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.523921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.524106] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.635802] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: SUCCESS [ 724.636044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.895529] env[66854]: INFO networking_nsxv3.common.synchronization [req-89d6e8a5-6347-4ea8-bb64-d24bdadcd4cc req-ad0011cd-6cf4-41e8-843f-585d8a10b8c0 tempest-ServersTestMultiNic-36060217 tempest-ServersTestMultiNic-36060217-project-member] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 724.896134] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 724.898418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.898418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.030384] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.030384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.030384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.030384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.030384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.031945] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.032268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.032268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.036021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.036021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.036021] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 725.059918] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.060245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.061101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.061101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.061101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.073257] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 725.313686] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-475 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.313922] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-475" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.314011] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-475" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.314351] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-475" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.314672] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.314897] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.319088] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.319453] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.319605] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.319828] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.319998] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.320076] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.320151] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.320258] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.320363] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.320497] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.348022] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.348022] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.348022] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.348022] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-475" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.348022] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-57d34bd0-4826-40aa-a41d-9319157ca1dc taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.348022] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-57d34bd0-4826-40aa-a41d-9319157ca1dc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.348022] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-57d34bd0-4826-40aa-a41d-9319157ca1dc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.348022] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-57d34bd0-4826-40aa-a41d-9319157ca1dc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.348022] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57d34bd0-4826-40aa-a41d-9319157ca1dc',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.488698] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 in Status: SUCCESS [ 725.489044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.489150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.489376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.489568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.489715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.489786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.489954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.490041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.490114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.490211] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.849674] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.849756] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.849880] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.850360] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.850555] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.850801] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 57d34bd0-4826-40aa-a41d-9319157ca1dc not found, creating... [ 725.851243] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.851437] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.851581] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.851854] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.852117] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.852521] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.852754] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.852909] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.853170] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.853335] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.853517] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 57d34bd0-4826-40aa-a41d-9319157ca1dc is going to be created. [ 725.875408] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.875663] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.875769] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.876188] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.876537] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.876662] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-57d34bd0-4826-40aa-a41d-9319157ca1dc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.995644] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.499155] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3: rpc.has_security_group_logging(os_id): False [ 726.518835] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.519282] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.519282] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.519419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.519452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.519702] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.519797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.519916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.520034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.520115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.520218] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 is going to be created. [ 726.586458] env[66854]: INFO networking_nsxv3.common.synchronization [req-89d6e8a5-6347-4ea8-bb64-d24bdadcd4cc req-cd60ba4c-06ea-42f0-bdda-26b724f7c951 service nova] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_rules [ 726.586458] env[66854]: INFO networking_nsxv3.common.synchronization [req-89d6e8a5-6347-4ea8-bb64-d24bdadcd4cc req-cd60ba4c-06ea-42f0-bdda-26b724f7c951 service nova] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 726.586616] env[66854]: INFO networking_nsxv3.common.synchronization [req-89d6e8a5-6347-4ea8-bb64-d24bdadcd4cc req-cd60ba4c-06ea-42f0-bdda-26b724f7c951 service nova] Enqueued Resource ID: 57d34bd0-4826-40aa-a41d-9319157ca1dc with Priority: HIGHEST for action port [ 726.587641] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_rules [ 726.587816] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 726.587912] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57d34bd0-4826-40aa-a41d-9319157ca1dc with Priority: HIGHEST for action port [ 726.588264] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.588472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.588472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.588663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.588746] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.590148] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.590148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.590148] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-57d34bd0-4826-40aa-a41d-9319157ca1dc taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.590148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57d34bd0-4826-40aa-a41d-9319157ca1dc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.590148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57d34bd0-4826-40aa-a41d-9319157ca1dc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.590454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57d34bd0-4826-40aa-a41d-9319157ca1dc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.590454] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57d34bd0-4826-40aa-a41d-9319157ca1dc',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.606505] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.606505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.606505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.606505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.606505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.620936] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 in Status: IN_PROGRESS for 2s [ 727.088701] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 727.088701] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a deletion is rescheduled due to dependency. [ 727.088889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.088983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.089254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.089523] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.089772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.089772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.089874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.089874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.090031] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.094861] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.095156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.095255] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57d34bd0-4826-40aa-a41d-9319157ca1dc with status ACTIVE [ 727.095421] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.095564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.095647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.095915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.096058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.096331] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.096481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.096546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.096776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.096883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.097185] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.097295] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.097360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.097540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.097647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.097749] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57d34bd0-4826-40aa-a41d-9319157ca1dc is going to be updated. [ 727.152850] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.153047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.153129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.153293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.153449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.153629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57d34bd0-4826-40aa-a41d-9319157ca1dc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.452779] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.452965] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-588" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.453100] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-588" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.453637] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-588" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.454594] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.455855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.455855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.456184] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.456370] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.457048] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.457048] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.457048] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.457048] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.457048] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.457409] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.457409] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.481226] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.481435] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.481627] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.481910] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-588" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.482422] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.482691] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.483229] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.484254] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.484254] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.592392] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.895270] env[66854]: INFO networking_nsxv3.common.synchronization [None req-703a0635-5709-4911-b11f-3c31a164dd7b None None] Enqueued Resource ID: 237b20c0-a712-44dc-b4d5-6923434d6b0b with Priority: HIGHEST for action port [ 727.895818] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237b20c0-a712-44dc-b4d5-6923434d6b0b with Priority: HIGHEST for action port [ 727.896183] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-237b20c0-a712-44dc-b4d5-6923434d6b0b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.896359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-237b20c0-a712-44dc-b4d5-6923434d6b0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.896359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-237b20c0-a712-44dc-b4d5-6923434d6b0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.896617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-237b20c0-a712-44dc-b4d5-6923434d6b0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.896702] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('237b20c0-a712-44dc-b4d5-6923434d6b0b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.990406] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.990726] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.990850] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.991226] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.991392] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.991544] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677 not found, creating... [ 727.991817] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.991989] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.992114] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.992331] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.992446] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.992721] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.992891] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.993021] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.993333] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.993481] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.993617] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677 is going to be created. [ 728.021105] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.021329] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.021464] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.021688] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.021877] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.022149] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.095602] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.398995] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 237b20c0-a712-44dc-b4d5-6923434d6b0b [ 728.399327] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.399554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.399665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.399997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.400145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.400293] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:237b20c0-a712-44dc-b4d5-6923434d6b0b already deleted. [ 728.400423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-237b20c0-a712-44dc-b4d5-6923434d6b0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.605493] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.605493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.605493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.605493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.605493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.605493] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 728.634381] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 in Status: SUCCESS [ 728.634604] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.641799] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.642112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.642112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.642258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.642403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.653915] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 728.668129] env[66854]: INFO networking_nsxv3.common.synchronization [req-f01fff4b-4e3a-405f-99b2-c6cef0f1f43e req-0263e6ba-a6b0-44a0-bfa4-bc49e3f2cb57 tempest-SecurityGroupRulesTestJSON-1101102742 tempest-SecurityGroupRulesTestJSON-1101102742-project-member] Enqueued Resource ID: baaf2be9-fa8c-4689-b43b-0aa13e69bdb0 with Priority: HIGHEST for action security_group_rules [ 728.668666] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baaf2be9-fa8c-4689-b43b-0aa13e69bdb0 with Priority: HIGHEST for action security_group_rules [ 728.669088] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baaf2be9-fa8c-4689-b43b-0aa13e69bdb0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.669200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baaf2be9-fa8c-4689-b43b-0aa13e69bdb0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.669200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baaf2be9-fa8c-4689-b43b-0aa13e69bdb0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.669895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baaf2be9-fa8c-4689-b43b-0aa13e69bdb0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.669895] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baaf2be9-fa8c-4689-b43b-0aa13e69bdb0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.779325] env[66854]: INFO networking_nsxv3.common.synchronization [req-89d6e8a5-6347-4ea8-bb64-d24bdadcd4cc req-21093331-a26f-4f4a-95a6-79d341e78d0d service nova] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_rules [ 728.779607] env[66854]: INFO networking_nsxv3.common.synchronization [req-89d6e8a5-6347-4ea8-bb64-d24bdadcd4cc req-21093331-a26f-4f4a-95a6-79d341e78d0d service nova] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 728.779778] env[66854]: INFO networking_nsxv3.common.synchronization [req-89d6e8a5-6347-4ea8-bb64-d24bdadcd4cc req-21093331-a26f-4f4a-95a6-79d341e78d0d service nova] Enqueued Resource ID: 3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677 with Priority: HIGHEST for action port [ 728.782331] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_rules [ 728.782331] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 728.782331] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677 with Priority: HIGHEST for action port [ 728.782331] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.782524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.782692] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.782787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.783030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.783100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.783166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.783393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.783444] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.190180] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.190336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.190411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.190633] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.190728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.190827] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baaf2be9-fa8c-4689-b43b-0aa13e69bdb0 already deleted. [ 729.190911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baaf2be9-fa8c-4689-b43b-0aa13e69bdb0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.288760] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677 with status ACTIVE [ 729.289080] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.289269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.289345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.289537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.289628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.289810] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.289909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.289971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.290177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.290259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.290466] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.290588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.290685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.290845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.291437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.291437] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677 is going to be updated. [ 729.328907] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.329154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.329154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.329441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.329591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.329766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ffff3d4-8ac0-4c0a-ab5e-c6230f5bc677" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.505415] env[66854]: INFO networking_nsxv3.common.synchronization [req-939893f1-c9fb-4656-a62b-b1f436b68828 req-a22ebb48-7b60-4ed9-82f9-45d5a55e9269 tempest-VolumesAssistedSnapshotsTest-1107862057 tempest-VolumesAssistedSnapshotsTest-1107862057-project-member] Enqueued Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_members [ 729.505415] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGHEST for action security_group_members [ 729.505415] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-004af225-cfe6-418e-bf9b-b21fc4fcd911 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.505415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.505834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.505834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.505834] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.505962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.505962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.506553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.506650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.506751] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.523982] env[66854]: INFO networking_nsxv3.common.synchronization [req-57de1757-df27-4c60-872c-f1bb9931a873 req-7fa0c2ff-2017-42db-8202-19a110c40500 tempest-ImagesNegativeTestJSON-2008465481 tempest-ImagesNegativeTestJSON-2008465481-project-member] Enqueued Resource ID: 92583910-38be-424b-ae0b-e27f87da131b with Priority: HIGHEST for action security_group_members [ 729.525015] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92583910-38be-424b-ae0b-e27f87da131b with Priority: HIGHEST for action security_group_members [ 729.525117] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-92583910-38be-424b-ae0b-e27f87da131b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.525212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.528061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.528061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.528061] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.528061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.528061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.528061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.528061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.528061] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92583910-38be-424b-ae0b-e27f87da131b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.859486] env[66854]: INFO networking_nsxv3.common.synchronization [req-b92df762-434f-48e6-8c89-874bb00f8864 req-17a75cc7-ad11-41b4-abb1-6e2262ad4669 tempest-MultipleCreateTestJSON-768742875 tempest-MultipleCreateTestJSON-768742875-project-member] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 729.860104] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 729.861194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.861194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.861194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.861194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.861484] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.861537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.862498] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.862571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.863896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.863896] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.011590] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.011790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.011871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.012144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.012670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.013011] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.013155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.013254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.013452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.013547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.013678] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 is going to be updated. [ 730.030166] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.030425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.030563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.030930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.031451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.031815] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.031957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.032054] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.032306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.032445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.032554] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92583910-38be-424b-ae0b-e27f87da131b is going to be updated. [ 730.062702] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.063072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.063207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.063543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.063780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.078630] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 in Status: IN_PROGRESS for 2s [ 730.081884] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.082381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.082381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.082498] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.083310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.093088] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92583910-38be-424b-ae0b-e27f87da131b in Status: IN_PROGRESS for 2s [ 730.365696] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.504748] env[66854]: INFO networking_nsxv3.common.synchronization [req-9fd481ba-c483-43b1-a5ef-1766f0c5038b req-78f1dc70-259a-445d-bc68-660fba2c58d4 tempest-MultipleCreateTestJSON-768742875 tempest-MultipleCreateTestJSON-768742875-project-member] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 730.504748] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGHEST for action security_group_members [ 730.505391] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.505519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.663724] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 730.663959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.664648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.664648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.664648] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.664940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.664940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.665815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.665815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.665815] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.869092] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.167848] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.371506] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.371669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.371742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.371956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.372060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.372162] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 731.401355] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.401942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.402208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.402417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.402569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.412036] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 731.483240] env[66854]: INFO networking_nsxv3.common.synchronization [req-47698c46-d0ab-44fe-ae1e-e4e7e7fcdd84 req-8cdc621f-7d31-4340-8caf-d811593a1300 tempest-ServersTestBootFromVolume-1832221709 tempest-ServersTestBootFromVolume-1832221709-project-member] Enqueued Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_members [ 731.483989] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGHEST for action security_group_members [ 731.488019] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-82708b01-13e8-453a-8492-93929a99b850 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.488019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.488019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.488019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.488019] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.488019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.488019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.488019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.488019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.488019] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.673247] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.989945] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.990390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.990390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.990473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.990526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.990737] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.990840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.990902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.991074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.991182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.991276] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82708b01-13e8-453a-8492-93929a99b850 is going to be updated. [ 732.030049] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.030249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.030298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.030519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.030664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.038139] env[66854]: INFO networking_nsxv3.common.synchronization [req-42e03bd6-39c8-46e7-8ca1-2c2b0b99071b req-7e750554-2024-47c3-abae-c979c5d3bda0 tempest-ServersAdminTestJSON-1278843131 tempest-ServersAdminTestJSON-1278843131-project-member] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 732.038139] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 732.038655] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.038655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.038655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.038655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.038811] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.038911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.038975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.039262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.039352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.039578] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.042538] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82708b01-13e8-453a-8492-93929a99b850 in Status: IN_PROGRESS for 2s [ 732.098461] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 in Status: SUCCESS [ 732.099466] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 deletion is rescheduled due to dependency. [ 732.099466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.104911] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92583910-38be-424b-ae0b-e27f87da131b in Status: SUCCESS [ 732.105102] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92583910-38be-424b-ae0b-e27f87da131b deletion is rescheduled due to dependency. [ 732.105295] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.176869] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.177025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.177092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.177315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.177409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.177513] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 732.237673] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.237673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.237673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.237673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.237673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.248475] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 732.544076] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.625616] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.625897] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.626088] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.626593] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.626987] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.627232] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.628047] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.628047] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.628047] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.628254] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.628310] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.628369] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.628469] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.628601] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.628798] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.628945] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.649334] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.649537] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.649679] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.649850] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.650222] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-2a82396d-f31e-431b-9f3a-df820bbd85b0 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.650381] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-2a82396d-f31e-431b-9f3a-df820bbd85b0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.650499] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-2a82396d-f31e-431b-9f3a-df820bbd85b0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.650802] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-2a82396d-f31e-431b-9f3a-df820bbd85b0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.650937] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a82396d-f31e-431b-9f3a-df820bbd85b0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.047706] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.153912] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.154221] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.154359] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.154715] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.154893] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.155018] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 2a82396d-f31e-431b-9f3a-df820bbd85b0 not found, creating... [ 733.155275] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.155423] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.155611] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.155857] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.155992] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.156283] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.156519] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.156901] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.158494] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.158494] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.158788] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 2a82396d-f31e-431b-9f3a-df820bbd85b0 is going to be created. [ 733.180535] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.180802] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.180943] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.183638] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.183638] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.183638] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-2a82396d-f31e-431b-9f3a-df820bbd85b0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.424556] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 733.424556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.424556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.424556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.424961] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.424961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.424961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.424961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.425216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.425216] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.550668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.550668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.550935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.550986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.551098] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.551203] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 733.568329] env[66854]: INFO networking_nsxv3.common.synchronization [None req-66b5c188-db02-4e7e-9646-069a5bfd2b24 None None] Enqueued Resource ID: c69fd254-611c-496e-b77f-292bb0491f3f with Priority: HIGHEST for action port [ 733.568904] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69fd254-611c-496e-b77f-292bb0491f3f with Priority: HIGHEST for action port [ 733.569226] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c69fd254-611c-496e-b77f-292bb0491f3f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.569347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c69fd254-611c-496e-b77f-292bb0491f3f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.569416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c69fd254-611c-496e-b77f-292bb0491f3f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.569715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c69fd254-611c-496e-b77f-292bb0491f3f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.569808] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69fd254-611c-496e-b77f-292bb0491f3f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.583865] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.584049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.584110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.584329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.584500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.595583] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 733.888396] env[66854]: INFO networking_nsxv3.common.synchronization [req-42e03bd6-39c8-46e7-8ca1-2c2b0b99071b req-fb91470d-e9bb-4740-ade2-826ae4af20f6 service nova] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_rules [ 733.888580] env[66854]: INFO networking_nsxv3.common.synchronization [req-42e03bd6-39c8-46e7-8ca1-2c2b0b99071b req-fb91470d-e9bb-4740-ade2-826ae4af20f6 service nova] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 733.888729] env[66854]: INFO networking_nsxv3.common.synchronization [req-42e03bd6-39c8-46e7-8ca1-2c2b0b99071b req-fb91470d-e9bb-4740-ade2-826ae4af20f6 service nova] Enqueued Resource ID: 2a82396d-f31e-431b-9f3a-df820bbd85b0 with Priority: HIGHEST for action port [ 733.889254] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_rules [ 733.889392] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 733.889490] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a82396d-f31e-431b-9f3a-df820bbd85b0 with Priority: HIGHEST for action port [ 733.889753] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.889898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.889943] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.894018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.894018] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.894018] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.894018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.894018] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a82396d-f31e-431b-9f3a-df820bbd85b0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.894018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a82396d-f31e-431b-9f3a-df820bbd85b0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.894018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a82396d-f31e-431b-9f3a-df820bbd85b0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.894018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a82396d-f31e-431b-9f3a-df820bbd85b0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.894018] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a82396d-f31e-431b-9f3a-df820bbd85b0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.928309] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.928522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.929064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.929487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.929657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.930427] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.932434] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.932548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.932832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.932976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.933156] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be updated. [ 734.017710] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.017863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.017863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.018107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.018264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.034027] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: IN_PROGRESS for 2s [ 734.052576] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82708b01-13e8-453a-8492-93929a99b850 in Status: SUCCESS [ 734.052576] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82708b01-13e8-453a-8492-93929a99b850 deletion is rescheduled due to dependency. [ 734.052576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.072761] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c69fd254-611c-496e-b77f-292bb0491f3f [ 734.073028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.073491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.073491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.073491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.073644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.073644] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c69fd254-611c-496e-b77f-292bb0491f3f already deleted. [ 734.073706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c69fd254-611c-496e-b77f-292bb0491f3f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.257463] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 4s [ 734.397881] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.398009] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.398246] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a82396d-f31e-431b-9f3a-df820bbd85b0 with status ACTIVE [ 734.398446] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.398604] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.398707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.398926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.399032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.399205] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.399303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.399366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.402449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.402564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.402934] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.402934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.402934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.406079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.406079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.406079] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a82396d-f31e-431b-9f3a-df820bbd85b0 is going to be updated. [ 734.427890] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.428062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.428121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.428439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.428727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.428926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a82396d-f31e-431b-9f3a-df820bbd85b0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.730220] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-8da04870-5dfa-4ec1-a7fb-305dc01c02fa tempest-ListServersNegativeTestJSON-1804165574 tempest-ListServersNegativeTestJSON-1804165574-project-member] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 734.730220] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 734.730220] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.730220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.730220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.731144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.731588] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.731959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.732154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.732466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.734562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.734562] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.237181] env[66854]: INFO networking_nsxv3.common.synchronization [req-5cb6b540-f23a-458b-a7ea-33ffdf2caad1 req-34d50048-98ee-4990-8794-a31c4aaf24e5 tempest-ImagesOneServerTestJSON-1695644909 tempest-ImagesOneServerTestJSON-1695644909-project-member] Enqueued Resource ID: a491a51f-1883-4e2c-a822-89d817e590ca with Priority: HIGHEST for action security_group_members [ 735.238472] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.238472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.238472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.238472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.238472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.238472] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.238472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.238728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.238728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.238922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.238922] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 already deleted. [ 735.239014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.239509] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a491a51f-1883-4e2c-a822-89d817e590ca with Priority: HIGHEST for action security_group_members [ 735.239788] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a491a51f-1883-4e2c-a822-89d817e590ca taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.239972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.239972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.240121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.240258] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.240978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.240978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.240978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.240978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.240978] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a491a51f-1883-4e2c-a822-89d817e590ca',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.606781] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 735.607361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.607447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.608798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.608798] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.608983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.608983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.609286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.609286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.609409] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.678235] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.678458] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.678554] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.678919] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.679221] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.679378] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.679489] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.679709] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.679844] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.680767] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.680767] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.680767] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.680767] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.680767] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.680767] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.680767] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.699709] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.699874] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 735.699990] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.700178] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.700488] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-f0427be4-65bd-4666-8c78-0bdcb254f5f4 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.700651] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-f0427be4-65bd-4666-8c78-0bdcb254f5f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.702436] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-f0427be4-65bd-4666-8c78-0bdcb254f5f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.702436] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-f0427be4-65bd-4666-8c78-0bdcb254f5f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.702436] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0427be4-65bd-4666-8c78-0bdcb254f5f4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.742755] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.742909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.742983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.743218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.743313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.743506] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.743613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.743679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.743930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.744030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.744124] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a491a51f-1883-4e2c-a822-89d817e590ca is going to be updated. [ 735.773514] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.773692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.773762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.773968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.774277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.783211] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a491a51f-1883-4e2c-a822-89d817e590ca in Status: IN_PROGRESS for 2s [ 736.046386] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1871982-9cf3-4b58-bd63-59badb5546d2 in Status: SUCCESS [ 736.046811] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 deletion is rescheduled due to dependency. [ 736.046811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.112302] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.204637] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.204917] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.205111] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.205339] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.205482] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.206139] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port f0427be4-65bd-4666-8c78-0bdcb254f5f4 not found, creating... [ 736.206139] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.206139] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.207049] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.207049] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.207049] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.207049] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.207180] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.207257] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.207681] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.207681] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.207681] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: f0427be4-65bd-4666-8c78-0bdcb254f5f4 is going to be created. [ 736.230906] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.230906] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.230906] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.230906] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.230906] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.230906] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-f0427be4-65bd-4666-8c78-0bdcb254f5f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.268312] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 736.268312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.268780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.269525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.269525] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.269525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.269525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.269525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.269525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.269767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.269767] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.270554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.270722] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.272081] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.272081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.272081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.272081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.272081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.272081] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.287038] env[66854]: INFO networking_nsxv3.common.synchronization [None req-73d5befb-59af-4fc0-9f2e-b9638733f3b3 None None] Enqueued Resource ID: bf814ea8-fa19-4ac7-9b2f-0aada063efc9 with Priority: HIGHEST for action port [ 736.288173] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf814ea8-fa19-4ac7-9b2f-0aada063efc9 with Priority: HIGHEST for action port [ 736.288702] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf814ea8-fa19-4ac7-9b2f-0aada063efc9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.288702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf814ea8-fa19-4ac7-9b2f-0aada063efc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.288865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf814ea8-fa19-4ac7-9b2f-0aada063efc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.289248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf814ea8-fa19-4ac7-9b2f-0aada063efc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.289248] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf814ea8-fa19-4ac7-9b2f-0aada063efc9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.614364] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.772957] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.772957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.776660] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.791081] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf814ea8-fa19-4ac7-9b2f-0aada063efc9 [ 736.791525] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.791525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.791525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.791813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.791911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.792028] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf814ea8-fa19-4ac7-9b2f-0aada063efc9 already deleted. [ 736.792332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf814ea8-fa19-4ac7-9b2f-0aada063efc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.004851] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-fa99bc1f-2bf0-45ed-9cb9-320fc329657b service nova] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_rules [ 737.004851] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-fa99bc1f-2bf0-45ed-9cb9-320fc329657b service nova] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 737.005070] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-fa99bc1f-2bf0-45ed-9cb9-320fc329657b service nova] Enqueued Resource ID: f0427be4-65bd-4666-8c78-0bdcb254f5f4 with Priority: HIGHEST for action port [ 737.005585] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_rules [ 737.005733] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 737.005834] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0427be4-65bd-4666-8c78-0bdcb254f5f4 with Priority: HIGHEST for action port [ 737.006507] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.006778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.006901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.007455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.007700] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.008986] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.009114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.009177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.009586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.009759] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.010518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.010612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.010806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.010902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.011040] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.012267] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0427be4-65bd-4666-8c78-0bdcb254f5f4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.012782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0427be4-65bd-4666-8c78-0bdcb254f5f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.012782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0427be4-65bd-4666-8c78-0bdcb254f5f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.012782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0427be4-65bd-4666-8c78-0bdcb254f5f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.012782] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0427be4-65bd-4666-8c78-0bdcb254f5f4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.117435] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.117435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.117435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.117743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.117743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.117743] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 737.164770] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.165084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.165084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.165224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.165389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.175957] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 737.250587] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-7ed64272-0f47-4045-8c8c-5f2c0ffb0f55 tempest-ListServersNegativeTestJSON-1804165574 tempest-ListServersNegativeTestJSON-1804165574-project-member] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 737.251176] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 737.251457] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.251675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.281533] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.517187] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.518287] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.518416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.522320] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0427be4-65bd-4666-8c78-0bdcb254f5f4 with status ACTIVE [ 737.523199] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.523199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.523199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.523199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.523199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.523469] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.523521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.523592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.523759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.523839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.524043] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.524133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.524197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.524336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.524411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.524496] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0427be4-65bd-4666-8c78-0bdcb254f5f4 is going to be updated. [ 737.560453] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.560614] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.560662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.560861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.560996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.561178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0427be4-65bd-4666-8c78-0bdcb254f5f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.638468] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.638468] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.638878] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.639356] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.641428] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.641428] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.641428] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.641428] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.641428] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.641428] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.641428] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.641428] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.641428] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.641428] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.641428] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.641936] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.664702] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.664876] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.665019] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.665197] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.665535] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.666023] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.666023] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.666862] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.666862] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.784814] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.785201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.785201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.785346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.785346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.785442] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 737.794856] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a491a51f-1883-4e2c-a822-89d817e590ca in Status: SUCCESS [ 737.795087] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a491a51f-1883-4e2c-a822-89d817e590ca deletion is rescheduled due to dependency. [ 737.795217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.813857] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.814012] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.814160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.814297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.814442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.826630] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 738.019836] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.168932] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.169257] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.169465] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.169762] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.169906] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.170075] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972 not found, creating... [ 738.170449] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.170546] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.170630] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.170899] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.171077] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.172310] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.172769] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.172769] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.172841] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.173027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.173165] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972 is going to be created. [ 738.195660] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.196046] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.196046] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.196264] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.196479] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.196763] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.523782] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.524094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.524094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.524249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.524344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.524442] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be created. [ 738.547328] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.547477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.547570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.547786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.547950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.557562] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: UNINITIALIZED for 2s [ 738.909390] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-fa4eb572-36af-4571-8b12-aebac35281de service nova] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_rules [ 738.909850] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-fa4eb572-36af-4571-8b12-aebac35281de service nova] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 738.909850] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-fa4eb572-36af-4571-8b12-aebac35281de service nova] Enqueued Resource ID: 8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972 with Priority: HIGHEST for action port [ 738.909930] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_rules [ 738.910048] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 738.910154] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972 with Priority: HIGHEST for action port [ 738.910695] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.910802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.910994] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.912380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.912997] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.913202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.913202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.913661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.913661] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.189544] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 739.189544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.189544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.189544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.189544] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.189544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.189544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.189544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.189544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.189544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.189544] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.416851] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972 with status ACTIVE [ 739.417224] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.417364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.417458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.417810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.418162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.418243] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.418403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.418578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.419193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.419193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.419310] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.421020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.421020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.421020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.421020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.421020] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972 is going to be updated. [ 739.447429] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.447429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.447429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.447429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.447429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.447429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8440c5bc-71ac-4ed7-8cde-7cb0aa0ca972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.693476] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.693729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.693729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.693940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.694166] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.695431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.695431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.695431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.695431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.695431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.695431] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.695431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.695431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.695431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.695431] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.695431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.695981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.695981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.695981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.695981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.695981] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.837609] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 739.837609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.838200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.838438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.838689] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.838856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.838904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.839136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.839242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.839344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.839542] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.839658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.839722] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.839887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.840058] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.840155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.840218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.840355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.840461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.840536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.840665] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.198811] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 404f4fa4-39e5-44f2-b930-0c5f5853142c: rpc.has_security_group_logging(os_id): False [ 740.222766] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.222958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.223018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.223284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.223379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.223506] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.223606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.223667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.224172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.224172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.224172] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.224392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.224392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.224451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.224492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.224697] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.224784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.224841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.224978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.225063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.225150] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 740.302290] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.302462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.304465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.304465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.304465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.320417] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 740.345146] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 141d1a4a-af29-49fe-8321-94ad97de005a: rpc.has_security_group_logging(os_id): False [ 740.367059] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.367059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.367059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.367059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.367059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.367059] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.367059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.367059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.367947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.368268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.369138] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.369138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.369489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.369555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.369728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.369960] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.370237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.370237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.370424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.370561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.370696] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 740.471488] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.471700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.471700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.471935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.472128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.490390] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 740.568300] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 740.568763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.568763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.569471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.569471] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.569471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.569471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.569471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.569693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.569693] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.073303] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.104539] env[66854]: INFO networking_nsxv3.common.synchronization [None req-58927c0c-6ab8-42ca-af45-4351b82e2390 None None] Enqueued Resource ID: 8328bffe-11d6-4afe-8211-e2f7c184bbcc with Priority: HIGHEST for action port [ 741.105604] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8328bffe-11d6-4afe-8211-e2f7c184bbcc with Priority: HIGHEST for action port [ 741.105926] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8328bffe-11d6-4afe-8211-e2f7c184bbcc taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.106064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8328bffe-11d6-4afe-8211-e2f7c184bbcc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.106136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8328bffe-11d6-4afe-8211-e2f7c184bbcc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.106424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8328bffe-11d6-4afe-8211-e2f7c184bbcc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.106521] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8328bffe-11d6-4afe-8211-e2f7c184bbcc',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.579445] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.608645] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8328bffe-11d6-4afe-8211-e2f7c184bbcc [ 741.609071] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.609245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.609310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.610719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.610719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.610719] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8328bffe-11d6-4afe-8211-e2f7c184bbcc already deleted. [ 741.610719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8328bffe-11d6-4afe-8211-e2f7c184bbcc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.082701] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.085819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.085819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.085819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.085819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.085819] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be updated. [ 742.123213] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.123374] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.123445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.123621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.123782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.147756] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 742.349941] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 742.350368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.507750] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 742.507750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.508080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.508369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.508499] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.512862] env[66854]: INFO networking_nsxv3.common.synchronization [req-a05540ec-95bf-41ac-960d-bd9cba5f5418 req-2a526fa4-f6ed-4280-a0fa-eca379b66e52 tempest-ServersV294TestFqdnHostnames-1797053889 tempest-ServersV294TestFqdnHostnames-1797053889-project-member] Enqueued Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_members [ 742.515268] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGHEST for action security_group_members [ 742.516166] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.516389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.516571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.516871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.517137] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.517467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.517467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.517618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.518564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.518564] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.014788] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.015024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.015172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.019238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.019238] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.019238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.019238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.019238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.019238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.019238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.019238] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.024909] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.025029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.025161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.025363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.025458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.025653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.025801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.025911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.025977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.026065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.026153] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa is going to be updated. [ 743.061288] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.061504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.061563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.061765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.061904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.074884] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa in Status: IN_PROGRESS for 2s [ 743.520059] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.520472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.520472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.520623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.520827] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.521033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.521078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.521251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.522341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.522341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.522341] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.522341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.522341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.522341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.522341] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.522341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.522341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.522630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.522630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.522764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.522813] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.583488] env[66854]: INFO networking_nsxv3.common.synchronization [req-66ad23c0-0c36-4020-b7d2-9459332b8312 req-77dd8b02-4dc6-4d40-a208-10689da8ed39 tempest-FloatingIPsAssociationTestJSON-1643548393 tempest-FloatingIPsAssociationTestJSON-1643548393-project-member] Enqueued Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 743.584069] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGHEST for action security_group_members [ 743.584574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.584574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.584574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.584860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.588256] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.588483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.588559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.588805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.588899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.589043] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.025243] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 141d1a4a-af29-49fe-8321-94ad97de005a: rpc.has_security_group_logging(os_id): False [ 744.063324] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.063324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.063324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.063607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.063607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.064423] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.064423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.064423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.064423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.064423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.064732] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.064732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.064828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.065021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.065148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.065387] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.065514] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.065583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.065758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.065921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.065981] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 744.095111] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.095396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.095396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.095600] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.095700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.095906] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.096068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.096134] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.096257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.096363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.096428] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b68d89c-9278-4047-a0c4-e471d31223ed is going to be updated. [ 744.122701] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.122908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.122908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.123390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.123390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.133299] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: IN_PROGRESS for 2s [ 744.141216] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.141417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.141495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.141782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.141943] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.161962] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 744.163299] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 744.163299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.163299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.163299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.163487] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.163610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.163682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.164052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.164052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.164052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.164325] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.165040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.165274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.165491] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.165648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.165751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.165960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.166080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.166185] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.379428] env[66854]: INFO networking_nsxv3.common.synchronization [None req-bbbc3f98-4a1f-47cf-b33b-1461c77742eb None None] Enqueued Resource ID: c1cd69a0-b44e-4621-ba4f-85851bd3dd90 with Priority: HIGHEST for action port [ 744.379428] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1cd69a0-b44e-4621-ba4f-85851bd3dd90 with Priority: HIGHEST for action port [ 744.380469] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1cd69a0-b44e-4621-ba4f-85851bd3dd90 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.380766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1cd69a0-b44e-4621-ba4f-85851bd3dd90" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.380949] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1cd69a0-b44e-4621-ba4f-85851bd3dd90" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.382585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1cd69a0-b44e-4621-ba4f-85851bd3dd90" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.382585] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1cd69a0-b44e-4621-ba4f-85851bd3dd90',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.673457] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.673736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.673812] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.682235] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-9b17401a-66d7-494c-9b8c-12644966387d tempest-ListServersNegativeTestJSON-1804165574 tempest-ListServersNegativeTestJSON-1804165574-project-member] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 744.682235] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 744.682235] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.682235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.885885] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1cd69a0-b44e-4621-ba4f-85851bd3dd90 [ 744.886175] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.886313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.886383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.887618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.887618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.887618] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1cd69a0-b44e-4621-ba4f-85851bd3dd90 already deleted. [ 744.887618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1cd69a0-b44e-4621-ba4f-85851bd3dd90" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.086689] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa in Status: SUCCESS [ 745.086946] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa deletion is rescheduled due to dependency. [ 745.087277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.178081] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.235027] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.235027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.235027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.235027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.235027] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.235027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.235027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.235558] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.235829] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.236252] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.236488] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.236688] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.236920] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.237179] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.237411] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.237720] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.260541] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.260716] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.260854] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.261041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-468" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.261363] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-936d4138-89f9-44f7-97d7-d6d930aad64f taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.261532] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-936d4138-89f9-44f7-97d7-d6d930aad64f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.261645] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-936d4138-89f9-44f7-97d7-d6d930aad64f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.261965] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-936d4138-89f9-44f7-97d7-d6d930aad64f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.262125] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('936d4138-89f9-44f7-97d7-d6d930aad64f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.364235] env[66854]: INFO networking_nsxv3.common.synchronization [None req-ec8bf3ed-dd54-47ae-a077-9cd5080a3c87 None None] Enqueued Resource ID: 429bf61b-549e-4443-ab30-87c216beb96d with Priority: HIGHEST for action port [ 745.364235] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429bf61b-549e-4443-ab30-87c216beb96d with Priority: HIGHEST for action port [ 745.364235] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-429bf61b-549e-4443-ab30-87c216beb96d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.365578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-429bf61b-549e-4443-ab30-87c216beb96d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.365890] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-429bf61b-549e-4443-ab30-87c216beb96d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.366299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-429bf61b-549e-4443-ab30-87c216beb96d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.366503] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429bf61b-549e-4443-ab30-87c216beb96d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.682535] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.682535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.682535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.682535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.682535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.682535] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be updated. [ 745.714540] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.714764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.714922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.715088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.715425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.724818] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 745.766121] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.766446] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.766446] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.767310] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.767310] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.767310] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 936d4138-89f9-44f7-97d7-d6d930aad64f not found, creating... [ 745.767535] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.767756] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.767927] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.771370] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.771370] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.771370] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.771370] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.771370] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.771370] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.771370] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.771370] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 936d4138-89f9-44f7-97d7-d6d930aad64f is going to be created. [ 745.793821] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.794208] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.794412] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.794765] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.795070] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.795374] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-936d4138-89f9-44f7-97d7-d6d930aad64f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.868781] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 429bf61b-549e-4443-ab30-87c216beb96d [ 745.869028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.869174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.869246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.869507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.869668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.869826] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:429bf61b-549e-4443-ab30-87c216beb96d already deleted. [ 745.869968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-429bf61b-549e-4443-ab30-87c216beb96d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.143265] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b68d89c-9278-4047-a0c4-e471d31223ed in Status: SUCCESS [ 746.143446] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b68d89c-9278-4047-a0c4-e471d31223ed deletion is rescheduled due to dependency. [ 746.143563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.182142] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 746.182385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.554904] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-7527e211-78f0-4a32-a1ab-535de59fec93 service nova] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_rules [ 746.554904] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-7527e211-78f0-4a32-a1ab-535de59fec93 service nova] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 746.554904] env[66854]: INFO networking_nsxv3.common.synchronization [req-7f857ec8-ac80-4770-a6a6-579af0026488 req-7527e211-78f0-4a32-a1ab-535de59fec93 service nova] Enqueued Resource ID: 936d4138-89f9-44f7-97d7-d6d930aad64f with Priority: HIGHEST for action port [ 746.555097] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_rules [ 746.555273] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 746.555405] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936d4138-89f9-44f7-97d7-d6d930aad64f with Priority: HIGHEST for action port [ 746.555693] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.555790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.555971] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.556466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.556703] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-936d4138-89f9-44f7-97d7-d6d930aad64f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.556842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-936d4138-89f9-44f7-97d7-d6d930aad64f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.556907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-936d4138-89f9-44f7-97d7-d6d930aad64f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.557179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-936d4138-89f9-44f7-97d7-d6d930aad64f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.557280] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('936d4138-89f9-44f7-97d7-d6d930aad64f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.601450] env[66854]: INFO networking_nsxv3.common.synchronization [req-66d036b0-fcdd-416c-bbad-61f88c4860e1 req-0097cd3a-ff33-4d1c-bacf-040e23ae68ef tempest-SecurityGroupRulesTestJSON-1101102742 tempest-SecurityGroupRulesTestJSON-1101102742-project-member] Enqueued Resource ID: ef4223e3-316e-4207-8530-ee7114d08273 with Priority: HIGHEST for action security_group_rules [ 746.602089] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef4223e3-316e-4207-8530-ee7114d08273 with Priority: HIGHEST for action security_group_rules [ 746.602368] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef4223e3-316e-4207-8530-ee7114d08273 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.602513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.602594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.602888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.602982] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef4223e3-316e-4207-8530-ee7114d08273',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.782572] env[66854]: INFO networking_nsxv3.common.synchronization [req-e7ae918b-e16e-498f-9794-94e85ec81869 req-22c819c1-d2da-4b30-9c88-e25ed41df2b1 tempest-SecurityGroupRulesNegativeTestJSON-1179627419 tempest-SecurityGroupRulesNegativeTestJSON-1179627419-project-member] Enqueued Resource ID: 13f7a310-a953-4030-a555-503a5c2d6d04 with Priority: HIGHEST for action security_group_rules [ 746.783127] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13f7a310-a953-4030-a555-503a5c2d6d04 with Priority: HIGHEST for action security_group_rules [ 746.783427] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13f7a310-a953-4030-a555-503a5c2d6d04 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.783549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13f7a310-a953-4030-a555-503a5c2d6d04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.783860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13f7a310-a953-4030-a555-503a5c2d6d04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.784017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13f7a310-a953-4030-a555-503a5c2d6d04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.784121] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13f7a310-a953-4030-a555-503a5c2d6d04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.061202] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 936d4138-89f9-44f7-97d7-d6d930aad64f with status ACTIVE [ 747.061202] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.061202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.061202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.061202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.061202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.061785] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.062021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.062166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.062422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.062599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.064030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.064030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.064030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.064030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.064030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.064030] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 936d4138-89f9-44f7-97d7-d6d930aad64f is going to be updated. [ 747.089186] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.089378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.090036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.090036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.090036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.090219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-936d4138-89f9-44f7-97d7-d6d930aad64f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.139406] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.139597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.139635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.139913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.140068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.140218] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef4223e3-316e-4207-8530-ee7114d08273 already deleted. [ 747.140346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.313929] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.314650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.314650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.314650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.314650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.314650] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13f7a310-a953-4030-a555-503a5c2d6d04 already deleted. [ 747.315460] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13f7a310-a953-4030-a555-503a5c2d6d04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.354717] env[66854]: INFO networking_nsxv3.common.synchronization [req-6d82973b-69df-44a4-be8c-6e39c66fc146 req-ad45bcca-354d-46bc-8915-4e36f2f8026b tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_members [ 747.354927] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_members [ 747.356368] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e0f7e9-6f3b-4bea-945c-76f1da468a99 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.356368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.356368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.356842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.356903] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.356983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.357050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.357234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.357322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.357696] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.736431] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 747.736431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.736431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.737414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.737776] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.737776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.737776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.738132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.738201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.738811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.738811] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.738811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.738811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.739074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.739107] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.739264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.739264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.739453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.739497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.739557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.739642] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.743067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.743258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.743418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.743520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.743585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.743727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.743806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.743896] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.746577] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.753093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.753093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.753093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.753093] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.753093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.753093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.753093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.753093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.753093] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.753093] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.753093] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.753093] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.753093] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.753093] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.753949] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.773841] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.775524] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 747.775524] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.775524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.775524] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.775524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.775524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.775524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.775524] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.867398] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.867398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.867398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.867398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.867398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.867398] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.867398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.867398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.867398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.867398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.867398] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 already deleted. [ 747.867398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.937316] env[66854]: INFO networking_nsxv3.common.synchronization [None req-30e52c6e-d08e-4b91-bd2f-93f3f94cd046 None None] Enqueued Resource ID: e8725509-11bb-4c59-857a-7da1daa30f46 with Priority: HIGHEST for action port [ 747.938028] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8725509-11bb-4c59-857a-7da1daa30f46 with Priority: HIGHEST for action port [ 747.938813] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8725509-11bb-4c59-857a-7da1daa30f46 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.939083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8725509-11bb-4c59-857a-7da1daa30f46" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.939153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8725509-11bb-4c59-857a-7da1daa30f46" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.939492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8725509-11bb-4c59-857a-7da1daa30f46" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.939599] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8725509-11bb-4c59-857a-7da1daa30f46',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.256236] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.257509] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2102370c-50ee-4712-bad2-1dc6ac49ebb5: rpc.has_security_group_logging(os_id): False [ 748.276379] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.276541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.276615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.276815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.276903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.277123] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.277252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.277305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.277543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.277651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.277873] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.278413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.278470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.278618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.278717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.278929] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.279040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.279141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.279548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.279548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.279548] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be created. [ 748.281328] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.281542] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.281692] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.281931] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.282142] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.282356] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2 not found, creating... [ 748.282660] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.283036] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.283212] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.283469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.283710] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.284033] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.284228] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.284372] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.284606] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.284798] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.284964] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2 is going to be created. [ 748.308856] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.309101] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.309224] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.309504] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.309771] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.310026] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.333114] env[66854]: INFO networking_nsxv3.common.synchronization [req-3daac777-a27e-4fc4-9330-aae1664a6152 req-f3e9ae37-193c-4623-9765-166f3ec18578 tempest-SecurityGroupRulesTestJSON-1101102742 tempest-SecurityGroupRulesTestJSON-1101102742-project-member] Enqueued Resource ID: ef4223e3-316e-4207-8530-ee7114d08273 with Priority: HIGHEST for action security_group_rules [ 748.333695] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef4223e3-316e-4207-8530-ee7114d08273 with Priority: HIGHEST for action security_group_rules [ 748.334051] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef4223e3-316e-4207-8530-ee7114d08273 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.334188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.334259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.334556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.334556] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef4223e3-316e-4207-8530-ee7114d08273',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.359388] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.359633] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.359869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.360047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.360240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.374662] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 748.442673] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8725509-11bb-4c59-857a-7da1daa30f46 [ 748.442914] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.443627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.443627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.443627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.443627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.443627] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8725509-11bb-4c59-857a-7da1daa30f46 already deleted. [ 748.443926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8725509-11bb-4c59-857a-7da1daa30f46" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.761046] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.854022] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.854260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.854327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.854537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.854682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.854788] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef4223e3-316e-4207-8530-ee7114d08273 already deleted. [ 748.854879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.037067] env[66854]: INFO networking_nsxv3.common.synchronization [req-6d82973b-69df-44a4-be8c-6e39c66fc146 req-67706705-9135-4720-8811-70a25899a208 service nova] Enqueued Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_rules [ 749.037712] env[66854]: INFO networking_nsxv3.common.synchronization [req-6d82973b-69df-44a4-be8c-6e39c66fc146 req-67706705-9135-4720-8811-70a25899a208 service nova] Enqueued Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_members [ 749.037945] env[66854]: INFO networking_nsxv3.common.synchronization [req-6d82973b-69df-44a4-be8c-6e39c66fc146 req-67706705-9135-4720-8811-70a25899a208 service nova] Enqueued Resource ID: bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2 with Priority: HIGHEST for action port [ 749.039626] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_rules [ 749.040325] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_members [ 749.040505] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2 with Priority: HIGHEST for action port [ 749.040841] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.041224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.041224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.041348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.041389] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.042746] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e0f7e9-6f3b-4bea-945c-76f1da468a99 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.043011] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.043011] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.043361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.043620] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.043790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.043887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.044107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.044293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.044427] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.045458] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.045652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.045774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.045998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.046210] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.263950] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.264131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.264193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.264637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.264637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.264637] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be updated. [ 749.300526] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.300727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.300773] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.301058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.301217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.310716] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 749.549910] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e0f7e9-6f3b-4bea-945c-76f1da468a99 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.549910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.549910] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.549910] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2 with status ACTIVE [ 749.549910] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.549910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.549910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.550202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.550202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.550254] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.550935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.550935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.550935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.550935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.550935] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.550935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.551270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.552680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.552879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.553074] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2 is going to be updated. [ 749.576614] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.576853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.577043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.577222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.577523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.577734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bde5bfe2-d38d-46fd-8af9-f4ba5875a5d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.646484] env[66854]: INFO networking_nsxv3.common.synchronization [req-c70d09e6-8f5c-46e4-b9b9-08c16095fc04 req-4f6309ff-ff32-4855-90ac-93068d203955 tempest-SecurityGroupRulesNegativeTestJSON-1179627419 tempest-SecurityGroupRulesNegativeTestJSON-1179627419-project-member] Enqueued Resource ID: 13f7a310-a953-4030-a555-503a5c2d6d04 with Priority: HIGHEST for action security_group_rules [ 749.647807] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13f7a310-a953-4030-a555-503a5c2d6d04 with Priority: HIGHEST for action security_group_rules [ 749.648268] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13f7a310-a953-4030-a555-503a5c2d6d04 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.648757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13f7a310-a953-4030-a555-503a5c2d6d04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.648757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13f7a310-a953-4030-a555-503a5c2d6d04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.648757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13f7a310-a953-4030-a555-503a5c2d6d04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.648757] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13f7a310-a953-4030-a555-503a5c2d6d04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.055287] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.193800] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.193998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.194108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.197247] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.197247] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.197247] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13f7a310-a953-4030-a555-503a5c2d6d04 already deleted. [ 750.197247] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13f7a310-a953-4030-a555-503a5c2d6d04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.388124] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 750.388407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.388600] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.388821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.389666] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.391930] env[66854]: INFO networking_nsxv3.common.synchronization [req-4183324a-c9a3-4715-a0ea-41d493973e66 req-90862fb3-bba8-40e9-999f-ccb7ace804fa tempest-SecurityGroupRulesTestJSON-1101102742 tempest-SecurityGroupRulesTestJSON-1101102742-project-member] Enqueued Resource ID: ef4223e3-316e-4207-8530-ee7114d08273 with Priority: HIGHEST for action security_group_rules [ 750.393014] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef4223e3-316e-4207-8530-ee7114d08273 with Priority: HIGHEST for action security_group_rules [ 750.393014] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef4223e3-316e-4207-8530-ee7114d08273 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.393014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.393014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.393252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.393280] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef4223e3-316e-4207-8530-ee7114d08273',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.557684] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.560074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.560074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.560074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.560074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.560074] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 is going to be created. [ 750.583658] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.584826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.584826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.584826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.584826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.595529] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 in Status: UNINITIALIZED for 2s [ 750.760715] env[66854]: INFO networking_nsxv3.common.synchronization [None req-f9d420b1-05f4-4b90-8447-310003672a3c None None] Enqueued Resource ID: a3df34d8-a2d3-4634-9d3d-7ae03e4b10f2 with Priority: HIGHEST for action port [ 750.760715] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3df34d8-a2d3-4634-9d3d-7ae03e4b10f2 with Priority: HIGHEST for action port [ 750.760715] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3df34d8-a2d3-4634-9d3d-7ae03e4b10f2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.762206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3df34d8-a2d3-4634-9d3d-7ae03e4b10f2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.762324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3df34d8-a2d3-4634-9d3d-7ae03e4b10f2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.762759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3df34d8-a2d3-4634-9d3d-7ae03e4b10f2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.762905] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3df34d8-a2d3-4634-9d3d-7ae03e4b10f2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.893393] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.893585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.917300] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.917474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.917539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.917760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.917855] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.917946] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef4223e3-316e-4207-8530-ee7114d08273 already deleted. [ 750.918039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef4223e3-316e-4207-8530-ee7114d08273" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.251217] env[66854]: INFO networking_nsxv3.common.synchronization [req-30fae48c-efc9-4966-aad0-abe7497611de req-5867a6be-836a-4e89-b13f-f33b20eeb1e9 tempest-ServersTestMultiNic-36060217 tempest-ServersTestMultiNic-36060217-project-member] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 751.252798] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 751.252798] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.252798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.252798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.252798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.252798] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.252798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.252798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.252798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.252798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.252798] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.266154] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3df34d8-a2d3-4634-9d3d-7ae03e4b10f2 [ 751.266400] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.266532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.266614] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.266813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.266900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.266995] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3df34d8-a2d3-4634-9d3d-7ae03e4b10f2 already deleted. [ 751.267085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3df34d8-a2d3-4634-9d3d-7ae03e4b10f2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.336030] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 751.336030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.336030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.336030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.336030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.336030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.336030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.336030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.336030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.336030] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.541122] env[66854]: INFO networking_nsxv3.common.synchronization [req-30fae48c-efc9-4966-aad0-abe7497611de req-fec32688-a197-40d6-80b3-4e0bc02e3b7a tempest-ServersTestMultiNic-36060217 tempest-ServersTestMultiNic-36060217-project-member] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 751.541304] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGHEST for action security_group_members [ 751.541737] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.541875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.755301] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.838403] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.266023] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.319422] env[66854]: INFO networking_nsxv3.common.synchronization [req-ec818b70-1894-4036-a82c-7419c2f54900 req-346881f1-11ec-4710-b740-4848adf76b43 tempest-FloatingIPsAssociationNegativeTestJSON-1849276530 tempest-FloatingIPsAssociationNegativeTestJSON-1849276530-project-member] Enqueued Resource ID: 57f39420-06ae-4013-a107-2dab8327c1d0 with Priority: HIGHEST for action security_group_members [ 752.319992] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f39420-06ae-4013-a107-2dab8327c1d0 with Priority: HIGHEST for action security_group_members [ 752.320372] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f39420-06ae-4013-a107-2dab8327c1d0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.320541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.320788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.321512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.321512] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.321512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.321512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.321512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.321799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.322021] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57f39420-06ae-4013-a107-2dab8327c1d0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.342022] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.607338] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 in Status: SUCCESS [ 752.607427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.607890] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.607890] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.608148] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.608512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.608597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.608839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.608904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.608985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.609375] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.614235] env[66854]: INFO networking_nsxv3.common.synchronization [None req-be420bf0-0d8d-4df8-8fa6-ed628df2ca9a tempest-ServersTestFqdnHostnames-796960008 tempest-ServersTestFqdnHostnames-796960008-project-member] Enqueued Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_rules [ 752.616839] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_rules [ 752.616839] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.616839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.616839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.616839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.616839] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.723474] env[66854]: INFO networking_nsxv3.common.synchronization [None req-c6b61264-904b-40b4-824e-10b576ea239c tempest-ServersTestFqdnHostnames-796960008 tempest-ServersTestFqdnHostnames-796960008-project-member] Enqueued Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_rules [ 752.724093] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_rules [ 752.724821] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.725015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.766099] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.766252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.766363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.766629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.766745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.766857] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 752.805721] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.805721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.805721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.805853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.806108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.818642] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 752.827126] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.827126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.827126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.827314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.827314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.828031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.828031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.828031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.828031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.828031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.828031] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f39420-06ae-4013-a107-2dab8327c1d0 is going to be updated. [ 752.850989] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.850989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.850989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.851864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.851864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.852545] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be updated. [ 752.876751] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.876953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.877115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.877363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.877531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.889403] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f39420-06ae-4013-a107-2dab8327c1d0 in Status: IN_PROGRESS for 2s [ 752.899680] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.899887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.899937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.900139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.900434] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.915072] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 753.113396] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.139644] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.139644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.139644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.139644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.139644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.139644] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 already deleted. [ 753.139644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.139644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.139644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.139644] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.353989] env[66854]: INFO networking_nsxv3.common.synchronization [None req-952cf25c-45ec-4324-b252-39b6e185a6aa None None] Enqueued Resource ID: 31a99dc9-b75c-41c6-8a95-ccd874cd8d59 with Priority: HIGHEST for action port [ 753.354520] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a99dc9-b75c-41c6-8a95-ccd874cd8d59 with Priority: HIGHEST for action port [ 753.354938] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a99dc9-b75c-41c6-8a95-ccd874cd8d59 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.355050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a99dc9-b75c-41c6-8a95-ccd874cd8d59" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.355124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a99dc9-b75c-41c6-8a95-ccd874cd8d59" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.355598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a99dc9-b75c-41c6-8a95-ccd874cd8d59" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.355598] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a99dc9-b75c-41c6-8a95-ccd874cd8d59',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.620471] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00e0f7e9-6f3b-4bea-945c-76f1da468a99: rpc.has_security_group_logging(os_id): False [ 753.655688] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.655823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.655875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.656118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.657095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.657095] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.657095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.657095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.657095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.657380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.657380] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 is going to be created. [ 753.673961] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.674090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.674090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.675031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.675031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.675031] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 already deleted. [ 753.675031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.751889] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.752132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.752132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.752932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.752932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.767161] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 in Status: IN_PROGRESS for 2s [ 753.863827] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31a99dc9-b75c-41c6-8a95-ccd874cd8d59 [ 753.865236] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.865236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.865236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.865236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.865236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.865236] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31a99dc9-b75c-41c6-8a95-ccd874cd8d59 already deleted. [ 753.865236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a99dc9-b75c-41c6-8a95-ccd874cd8d59" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.981073] env[66854]: INFO networking_nsxv3.common.synchronization [None req-d1680524-6c67-491b-894b-5192ddd1c551 tempest-MigrationsAdminTest-1593966740 tempest-MigrationsAdminTest-1593966740-project-member] Enqueued Resource ID: fcfec9d4-1511-47f3-a4b5-f6db80e9fe68 with Priority: HIGHEST for action security_group_rules [ 753.981662] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfec9d4-1511-47f3-a4b5-f6db80e9fe68 with Priority: HIGHEST for action security_group_rules [ 753.982027] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcfec9d4-1511-47f3-a4b5-f6db80e9fe68 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.987334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcfec9d4-1511-47f3-a4b5-f6db80e9fe68" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.987334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcfec9d4-1511-47f3-a4b5-f6db80e9fe68" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.987334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcfec9d4-1511-47f3-a4b5-f6db80e9fe68" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.987334] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcfec9d4-1511-47f3-a4b5-f6db80e9fe68',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.097314] env[66854]: INFO networking_nsxv3.common.synchronization [None req-a1639d43-8c8f-4103-9830-df54fb0f0291 tempest-MigrationsAdminTest-1593966740 tempest-MigrationsAdminTest-1593966740-project-member] Enqueued Resource ID: fcfec9d4-1511-47f3-a4b5-f6db80e9fe68 with Priority: HIGHEST for action security_group_rules [ 754.099473] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfec9d4-1511-47f3-a4b5-f6db80e9fe68 with Priority: HIGHEST for action security_group_rules [ 754.100085] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcfec9d4-1511-47f3-a4b5-f6db80e9fe68 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.100379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcfec9d4-1511-47f3-a4b5-f6db80e9fe68" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.512243] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.512667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.512667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.512808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.512996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.513168] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcfec9d4-1511-47f3-a4b5-f6db80e9fe68 already deleted. [ 754.513313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcfec9d4-1511-47f3-a4b5-f6db80e9fe68" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.513588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcfec9d4-1511-47f3-a4b5-f6db80e9fe68" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.513874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcfec9d4-1511-47f3-a4b5-f6db80e9fe68" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.514067] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcfec9d4-1511-47f3-a4b5-f6db80e9fe68',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.832811] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 754.833581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.833581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.833581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.833828] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.834019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.834503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.834503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.834503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.834503] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.899425] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f39420-06ae-4013-a107-2dab8327c1d0 in Status: SUCCESS [ 754.899672] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f39420-06ae-4013-a107-2dab8327c1d0 deletion is rescheduled due to dependency. [ 754.899723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.928434] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 754.928652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.928886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.929120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.929310] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.929431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.929491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.929650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.929733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.929821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.929918] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.048546] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.048546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.048546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.048912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.048912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.049322] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcfec9d4-1511-47f3-a4b5-f6db80e9fe68 already deleted. [ 755.049322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcfec9d4-1511-47f3-a4b5-f6db80e9fe68" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.337315] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.337649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.337649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.337957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.338071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.338310] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.338438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.338500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.338680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.338807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.338899] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be updated. [ 755.376334] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.376548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.376735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.376977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.377160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.389722] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: IN_PROGRESS for 2s [ 755.436231] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.436629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.436629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.436739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.436832] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.436951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.437077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.437222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.437314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.437406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.437554] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.437714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.437787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.437930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.438091] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.438176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.438239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.438372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.438448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.438538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.438650] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.785818] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 in Status: SUCCESS [ 755.785818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.789289] env[66854]: INFO networking_nsxv3.common.synchronization [req-77f74cdd-0af6-440a-9a53-b2d8970518a2 req-ec3b3eab-c870-41aa-a342-3d87483042c8 tempest-ServerRescueNegativeTestJSON-1659784790 tempest-ServerRescueNegativeTestJSON-1659784790-project-member] Enqueued Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 755.789961] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 755.790302] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.790426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.790543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.791743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.791743] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.791743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.791743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.791743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.791743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.791743] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.941381] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2102370c-50ee-4712-bad2-1dc6ac49ebb5: rpc.has_security_group_logging(os_id): False [ 755.962177] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.962348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.962420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.962644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.962775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.963021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.963133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.963194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.963361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.963440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.963968] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.963968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.963968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.963968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.964219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.964315] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.964464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.964527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.964641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.964720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.964807] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be updated. [ 756.052777] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.052982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.052982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.053656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.053656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.072317] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 756.294912] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.295250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.295250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.295549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.295676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.295963] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.296131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.296218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.296522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.296522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.296899] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 already deleted. [ 756.296899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.653372] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-406 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.653651] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.653957] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.654133] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.654400] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.654545] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.654656] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.654875] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.655023] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.655302] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.655427] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.655427] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.655591] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.655664] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.655769] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.655933] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.680664] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.680943] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 756.681228] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.681518] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.682011] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-4159f1b4-2d24-440f-8f24-1bec9fc7456f taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.682342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-4159f1b4-2d24-440f-8f24-1bec9fc7456f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.682511] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-4159f1b4-2d24-440f-8f24-1bec9fc7456f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.682987] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-4159f1b4-2d24-440f-8f24-1bec9fc7456f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.683283] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4159f1b4-2d24-440f-8f24-1bec9fc7456f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.186525] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.186918] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.186918] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.187183] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.188047] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.188147] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 4159f1b4-2d24-440f-8f24-1bec9fc7456f not found, creating... [ 757.188454] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.188630] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.188768] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.189056] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.189211] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.189559] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.190769] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.190769] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.190769] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.190769] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.190769] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 4159f1b4-2d24-440f-8f24-1bec9fc7456f is going to be created. [ 757.212151] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.212374] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.214069] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.214069] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.214069] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.214069] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-4159f1b4-2d24-440f-8f24-1bec9fc7456f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.400057] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 141d1a4a-af29-49fe-8321-94ad97de005a in Status: SUCCESS [ 757.400304] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a deletion is rescheduled due to dependency. [ 757.400445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.982854] env[66854]: INFO networking_nsxv3.common.synchronization [req-77f74cdd-0af6-440a-9a53-b2d8970518a2 req-aa772264-fce2-4f47-8480-4e4fd9df3c45 service nova] Enqueued Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_rules [ 757.983403] env[66854]: INFO networking_nsxv3.common.synchronization [req-77f74cdd-0af6-440a-9a53-b2d8970518a2 req-aa772264-fce2-4f47-8480-4e4fd9df3c45 service nova] Enqueued Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 757.983403] env[66854]: INFO networking_nsxv3.common.synchronization [req-77f74cdd-0af6-440a-9a53-b2d8970518a2 req-aa772264-fce2-4f47-8480-4e4fd9df3c45 service nova] Enqueued Resource ID: 4159f1b4-2d24-440f-8f24-1bec9fc7456f with Priority: HIGHEST for action port [ 757.983847] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_rules [ 757.984035] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 757.984146] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4159f1b4-2d24-440f-8f24-1bec9fc7456f with Priority: HIGHEST for action port [ 757.984457] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.984615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.984716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.985046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.985196] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.986344] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.986487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.986564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.986863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.987262] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.987431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.987621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.988067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.988067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.988277] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.988957] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4159f1b4-2d24-440f-8f24-1bec9fc7456f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.989199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4159f1b4-2d24-440f-8f24-1bec9fc7456f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.989199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4159f1b4-2d24-440f-8f24-1bec9fc7456f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.990387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4159f1b4-2d24-440f-8f24-1bec9fc7456f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.990387] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4159f1b4-2d24-440f-8f24-1bec9fc7456f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.086351] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 758.086351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.086886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.086886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.086967] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.431831] env[66854]: INFO networking_nsxv3.common.synchronization [req-8725ceb7-615e-4bb5-adb4-c382b1cc86c7 req-ccd9e63f-8767-4712-bf71-4c358b5f08f1 tempest-ServersWithSpecificFlavorTestJSON-1363282919 tempest-ServersWithSpecificFlavorTestJSON-1363282919-project-member] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 758.431831] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 758.431831] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.431831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.431831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.431831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.431831] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.431831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.431831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.432586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.432803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.433018] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.491673] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.491878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.491972] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.493290] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4159f1b4-2d24-440f-8f24-1bec9fc7456f with status ACTIVE [ 758.493290] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.493290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.493290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.493597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.493597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.494536] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.494536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.494536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.494536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.494536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.494536] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.494536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.494536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.494832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.494832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.494832] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4159f1b4-2d24-440f-8f24-1bec9fc7456f is going to be updated. [ 758.518144] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.518315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.518392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.518565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.518699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.519120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4159f1b4-2d24-440f-8f24-1bec9fc7456f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.589733] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.589911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.590029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.590327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.590510] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.590616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.590682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.590837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.590926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.591026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.591161] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.938021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.938021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.938021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.938021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.938021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.938021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.938021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.938021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.938021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.938021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.938021] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e is going to be updated. [ 758.964580] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.967016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.967016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.967016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.967016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.974960] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: IN_PROGRESS for 2s [ 758.998165] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.097798] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.097798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.097798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.097798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.097798] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.098623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.098623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.098623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.098623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.098623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.098623] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.098623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.098936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.098936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.099050] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.099110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.099163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.099305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.099373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.099452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.099545] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.466166] env[66854]: INFO networking_nsxv3.common.synchronization [req-f2ab63dd-44e0-406b-86d5-1ce0389fd7c4 req-76f9c463-b2e9-48ff-bb6c-ef46d9be01a2 tempest-ServerMetadataTestJSON-1744485191 tempest-ServerMetadataTestJSON-1744485191-project-member] Enqueued Resource ID: 28446920-c13b-4dfc-87e9-c9f98af2604c with Priority: HIGHEST for action security_group_members [ 759.467118] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28446920-c13b-4dfc-87e9-c9f98af2604c with Priority: HIGHEST for action security_group_members [ 759.467118] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28446920-c13b-4dfc-87e9-c9f98af2604c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.467118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.467360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.467360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.467575] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.467683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.467683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.467818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.467921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.468045] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28446920-c13b-4dfc-87e9-c9f98af2604c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.501499] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.501686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.502681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.502681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.502681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.502681] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 is going to be created. [ 759.529125] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.529332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.529673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.529673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.529837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.541923] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: UNINITIALIZED for 2s [ 759.602669] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2102370c-50ee-4712-bad2-1dc6ac49ebb5: rpc.has_security_group_logging(os_id): False [ 759.622204] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.623315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.623315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.623315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.623533] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.623920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.624107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.624289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.624511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.624662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.626182] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.626182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.626182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.626182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.626182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.626182] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.626182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.626182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.626182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.626182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.626557] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be updated. [ 759.697277] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.697277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.697277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.697549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.697549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.711482] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 759.970302] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.970464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.970538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.970915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.970915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.971151] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.971249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.971343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.971582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.971582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.971702] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28446920-c13b-4dfc-87e9-c9f98af2604c is going to be updated. [ 760.011172] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.011172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.011172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.011172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.011172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.020144] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28446920-c13b-4dfc-87e9-c9f98af2604c in Status: IN_PROGRESS for 2s [ 760.987535] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: SUCCESS [ 760.987535] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e deletion is rescheduled due to dependency. [ 760.987535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.422028] env[66854]: INFO networking_nsxv3.common.synchronization [req-37dec49c-7634-45fc-b531-a3318b75aa1d req-92d152d8-55cf-4715-9656-e7e838f70bb6 tempest-ServerRescueNegativeTestJSON-1659784790 tempest-ServerRescueNegativeTestJSON-1659784790-project-member] Enqueued Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 761.422613] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 761.423730] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.423730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.558266] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: SUCCESS [ 761.558266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.559920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.560684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.560958] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.561163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.561259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.561794] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.561926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.562039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.562153] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.563478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.563581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.563846] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.564290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.564290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.564393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.564560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.564748] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.727637] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 761.728637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.005484] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-406 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.005790] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.005790] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.006151] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.006450] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.006875] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.006875] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.007056] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.007056] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.007265] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.007418] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.007477] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.007580] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.007684] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.007786] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.007988] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.028334] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.028513] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 762.028646] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.029718] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.029718] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-af29ecfc-7e7a-4a28-836d-a3d96d528c4d taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.029718] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-af29ecfc-7e7a-4a28-836d-a3d96d528c4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.029718] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-af29ecfc-7e7a-4a28-836d-a3d96d528c4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.029975] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-af29ecfc-7e7a-4a28-836d-a3d96d528c4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.030373] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af29ecfc-7e7a-4a28-836d-a3d96d528c4d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.032478] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28446920-c13b-4dfc-87e9-c9f98af2604c in Status: SUCCESS [ 762.032642] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28446920-c13b-4dfc-87e9-c9f98af2604c deletion is rescheduled due to dependency. [ 762.032749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.066829] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.067070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.072565] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.534728] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.535037] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.535179] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.535503] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.535649] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.535806] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port af29ecfc-7e7a-4a28-836d-a3d96d528c4d not found, creating... [ 762.536097] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.536318] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.536481] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.536884] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.537170] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.537669] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.537808] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.538012] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.538978] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.539675] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.540011] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: af29ecfc-7e7a-4a28-836d-a3d96d528c4d is going to be created. [ 762.566499] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.566705] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.566827] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.567110] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.567337] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.567569] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-af29ecfc-7e7a-4a28-836d-a3d96d528c4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.575279] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.078550] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.078822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.078822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.079038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.079173] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.079240] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 is going to be updated. [ 763.111780] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.111859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.111918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.112165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.112728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.124478] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: IN_PROGRESS for 2s [ 763.330245] env[66854]: INFO networking_nsxv3.common.synchronization [req-37dec49c-7634-45fc-b531-a3318b75aa1d req-b380465f-3c83-4cd9-ba11-b17af89e5621 service nova] Enqueued Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_rules [ 763.330452] env[66854]: INFO networking_nsxv3.common.synchronization [req-37dec49c-7634-45fc-b531-a3318b75aa1d req-b380465f-3c83-4cd9-ba11-b17af89e5621 service nova] Enqueued Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 763.330604] env[66854]: INFO networking_nsxv3.common.synchronization [req-37dec49c-7634-45fc-b531-a3318b75aa1d req-b380465f-3c83-4cd9-ba11-b17af89e5621 service nova] Enqueued Resource ID: af29ecfc-7e7a-4a28-836d-a3d96d528c4d with Priority: HIGHEST for action port [ 763.331145] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_rules [ 763.331281] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 763.331381] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af29ecfc-7e7a-4a28-836d-a3d96d528c4d with Priority: HIGHEST for action port [ 763.331657] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.331910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.331971] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.332186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.332399] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-af29ecfc-7e7a-4a28-836d-a3d96d528c4d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.332612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af29ecfc-7e7a-4a28-836d-a3d96d528c4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.332671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af29ecfc-7e7a-4a28-836d-a3d96d528c4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.332881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af29ecfc-7e7a-4a28-836d-a3d96d528c4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.333024] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af29ecfc-7e7a-4a28-836d-a3d96d528c4d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.835683] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af29ecfc-7e7a-4a28-836d-a3d96d528c4d with status ACTIVE [ 763.835931] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.836084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.836168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.836380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.836816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.836816] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.836816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.836959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.837067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.837122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.837306] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.837397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.838377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.838377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.838377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.838377] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af29ecfc-7e7a-4a28-836d-a3d96d528c4d is going to be updated. [ 763.859901] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.860615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.860615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.860615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.860780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.860848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af29ecfc-7e7a-4a28-836d-a3d96d528c4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.256873] env[66854]: INFO networking_nsxv3.common.synchronization [req-94bc90eb-6a73-4a98-8856-bd5155d91dea req-a24422a3-cdd7-4b2e-85b8-4818adc04529 tempest-InstanceActionsTestJSON-1805802000 tempest-InstanceActionsTestJSON-1805802000-project-member] Enqueued Resource ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 with Priority: HIGHEST for action security_group_members [ 764.257462] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 with Priority: HIGHEST for action security_group_members [ 764.257827] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f256f-0ee8-49eb-88ef-2d544feb1609 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.257956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.258078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.258426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.258701] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.259085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.259179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.259373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.259482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.259688] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a11f256f-0ee8-49eb-88ef-2d544feb1609',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.710779] env[66854]: INFO networking_nsxv3.common.synchronization [None req-4f9d5727-2925-44ec-ae5b-00c756ac3375 None None] Enqueued Resource ID: 166c8065-1ad8-444a-bcc7-8f665303a22e with Priority: HIGHEST for action port [ 764.710779] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166c8065-1ad8-444a-bcc7-8f665303a22e with Priority: HIGHEST for action port [ 764.711786] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-166c8065-1ad8-444a-bcc7-8f665303a22e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.711786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-166c8065-1ad8-444a-bcc7-8f665303a22e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.711786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-166c8065-1ad8-444a-bcc7-8f665303a22e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.711786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-166c8065-1ad8-444a-bcc7-8f665303a22e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.711786] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('166c8065-1ad8-444a-bcc7-8f665303a22e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.761946] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.762507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.762507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.762507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.762507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.762678] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.762779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.763375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.763375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.763375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.763375] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 already deleted. [ 764.763375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.134690] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: SUCCESS [ 765.134983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.135209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.135508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.135770] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.135927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.136052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.136257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.136357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.136479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.136700] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.137067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.137067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.137067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.137263] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.137388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.137494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.137677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.137777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.137882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.138017] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.139135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.139360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.139593] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.139731] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.139821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.140025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.140136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.141037] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.208354] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-694 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.208594] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-694" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.208948] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-694" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.208948] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-694" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.209280] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.209583] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.209658] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.209866] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.210027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.210234] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 765.210458] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 765.210553] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 765.210671] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 765.210800] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 765.210917] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 765.211291] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 765.215179] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 166c8065-1ad8-444a-bcc7-8f665303a22e [ 765.215423] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.215558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.215987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.215987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.215987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.216561] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:166c8065-1ad8-444a-bcc7-8f665303a22e already deleted. [ 765.216561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-166c8065-1ad8-444a-bcc7-8f665303a22e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.240034] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 765.240034] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 765.240034] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 765.240034] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-694" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.240034] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-35eaaada-1027-4615-bdfc-d705f7a2d76a taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.240034] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-35eaaada-1027-4615-bdfc-d705f7a2d76a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.240034] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-35eaaada-1027-4615-bdfc-d705f7a2d76a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.240034] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-35eaaada-1027-4615-bdfc-d705f7a2d76a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.240034] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35eaaada-1027-4615-bdfc-d705f7a2d76a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.642053] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0: rpc.has_security_group_logging(os_id): False [ 765.643215] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.663540] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.663540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.663540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.663872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.663872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.664030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.664030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.664185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.664286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.664286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.664463] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.664560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.664620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.664758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.664859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.665074] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.665219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.665260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.665389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.665510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.665566] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 is going to be created. [ 765.739288] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.739908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.739908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.739908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.740106] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.743025] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.743805] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.743805] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.743805] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.743805] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.743993] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 35eaaada-1027-4615-bdfc-d705f7a2d76a not found, creating... [ 765.744132] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.744296] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.744421] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.744718] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.744935] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.745251] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.745505] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.745691] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.745920] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.746069] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.746247] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 35eaaada-1027-4615-bdfc-d705f7a2d76a is going to be created. [ 765.756756] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: IN_PROGRESS for 2s [ 765.768481] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.768742] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.768808] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.769087] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.769312] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.769536] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-35eaaada-1027-4615-bdfc-d705f7a2d76a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.145302] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.492056] env[66854]: INFO networking_nsxv3.common.synchronization [req-94bc90eb-6a73-4a98-8856-bd5155d91dea req-0da53b5a-48ba-4662-8b9a-28463e6bb8f4 service nova] Enqueued Resource ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 with Priority: HIGHEST for action security_group_rules [ 766.492238] env[66854]: INFO networking_nsxv3.common.synchronization [req-94bc90eb-6a73-4a98-8856-bd5155d91dea req-0da53b5a-48ba-4662-8b9a-28463e6bb8f4 service nova] Enqueued Resource ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 with Priority: HIGHEST for action security_group_members [ 766.492378] env[66854]: INFO networking_nsxv3.common.synchronization [req-94bc90eb-6a73-4a98-8856-bd5155d91dea req-0da53b5a-48ba-4662-8b9a-28463e6bb8f4 service nova] Enqueued Resource ID: 35eaaada-1027-4615-bdfc-d705f7a2d76a with Priority: HIGHEST for action port [ 766.492875] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 with Priority: HIGHEST for action security_group_rules [ 766.494849] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 with Priority: HIGHEST for action security_group_members [ 766.495052] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35eaaada-1027-4615-bdfc-d705f7a2d76a with Priority: HIGHEST for action port [ 766.495340] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a11f256f-0ee8-49eb-88ef-2d544feb1609 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.498018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.498018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.498018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.498018] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a11f256f-0ee8-49eb-88ef-2d544feb1609',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.498018] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f256f-0ee8-49eb-88ef-2d544feb1609 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.498297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.498297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.498439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.498592] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.498683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.498742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.498884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.498963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.500171] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a11f256f-0ee8-49eb-88ef-2d544feb1609',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.500925] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-35eaaada-1027-4615-bdfc-d705f7a2d76a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.501042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35eaaada-1027-4615-bdfc-d705f7a2d76a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.501356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35eaaada-1027-4615-bdfc-d705f7a2d76a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.501533] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35eaaada-1027-4615-bdfc-d705f7a2d76a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.501614] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35eaaada-1027-4615-bdfc-d705f7a2d76a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.648939] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.648939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.649255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.649255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.649331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.649570] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 is going to be updated. [ 766.685103] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.685353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.685432] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.685808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.685808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.695281] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: IN_PROGRESS for 2s [ 766.999026] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f256f-0ee8-49eb-88ef-2d544feb1609 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.999026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.001321] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a11f256f-0ee8-49eb-88ef-2d544feb1609',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.003826] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35eaaada-1027-4615-bdfc-d705f7a2d76a with status ACTIVE [ 767.004084] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.004893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.004893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.004893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.004893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.004893] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.004893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.004893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.005225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.007646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.007646] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.007646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.007646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.007646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.007646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.007646] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35eaaada-1027-4615-bdfc-d705f7a2d76a is going to be updated. [ 767.032459] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.032707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.032941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.033270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.033476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.033613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35eaaada-1027-4615-bdfc-d705f7a2d76a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.418939] env[66854]: INFO networking_nsxv3.common.synchronization [None req-a1ce092b-8ea2-4d80-856f-b94ed999237d None None] Enqueued Resource ID: 126dd583-1ac2-4e16-bc71-44a1a48bdbd1 with Priority: HIGHEST for action port [ 767.419462] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dd583-1ac2-4e16-bc71-44a1a48bdbd1 with Priority: HIGHEST for action port [ 767.419759] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-126dd583-1ac2-4e16-bc71-44a1a48bdbd1 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.419882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-126dd583-1ac2-4e16-bc71-44a1a48bdbd1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.419970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-126dd583-1ac2-4e16-bc71-44a1a48bdbd1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.420360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-126dd583-1ac2-4e16-bc71-44a1a48bdbd1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.420471] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('126dd583-1ac2-4e16-bc71-44a1a48bdbd1',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.503165] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a11f256f-0ee8-49eb-88ef-2d544feb1609',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.772162] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: SUCCESS [ 767.772415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.772493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.772724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.772815] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.923646] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 126dd583-1ac2-4e16-bc71-44a1a48bdbd1 [ 767.923842] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.923992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.924090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.924320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.924424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.924530] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:126dd583-1ac2-4e16-bc71-44a1a48bdbd1 already deleted. [ 767.924625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-126dd583-1ac2-4e16-bc71-44a1a48bdbd1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.006292] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.006384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.006598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.006862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.006862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.006862] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 is going to be created. [ 768.042537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.042537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.042537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.042537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.042537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.055559] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 in Status: UNINITIALIZED for 2s [ 768.110020] env[66854]: INFO networking_nsxv3.common.synchronization [None req-fcb86fe4-664e-4d12-a874-021129c823b9 None None] Enqueued Resource ID: 06b2bae7-aed1-4f74-a16c-d57af6e6176b with Priority: HIGHEST for action port [ 768.110020] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b2bae7-aed1-4f74-a16c-d57af6e6176b with Priority: HIGHEST for action port [ 768.110020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-06b2bae7-aed1-4f74-a16c-d57af6e6176b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.110222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06b2bae7-aed1-4f74-a16c-d57af6e6176b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.110222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06b2bae7-aed1-4f74-a16c-d57af6e6176b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.110579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06b2bae7-aed1-4f74-a16c-d57af6e6176b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.110656] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06b2bae7-aed1-4f74-a16c-d57af6e6176b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.279057] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.279057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.613598] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06b2bae7-aed1-4f74-a16c-d57af6e6176b [ 768.613598] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.613598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.613598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.614083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.614083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.614919] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06b2bae7-aed1-4f74-a16c-d57af6e6176b already deleted. [ 768.614919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06b2bae7-aed1-4f74-a16c-d57af6e6176b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.709309] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: SUCCESS [ 768.709309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.709470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.709758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.709955] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.709955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.710129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.710279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.710351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.710418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.710653] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.213813] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.214244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.214244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.215808] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.215808] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.215808] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.215808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.216517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.216517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.216517] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.720518] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0: rpc.has_security_group_logging(os_id): False [ 769.739571] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.740063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.740204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.740528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.740528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.741180] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.741303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.741371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.741533] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.741610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.741803] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.741899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.741964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.743058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.743158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.743400] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.743513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.743582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.743760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.743842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.743931] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 is going to be updated. [ 769.841950] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.842141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.842238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.842426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.842903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.860047] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: IN_PROGRESS for 2s [ 769.906535] env[66854]: INFO networking_nsxv3.common.synchronization [None req-aea85047-71f2-4ee4-b7d7-a84e25b9eeca tempest-ServerActionsTestOtherB-456566424 tempest-ServerActionsTestOtherB-456566424-project-member] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 769.908155] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 769.909224] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.909510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.909510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.910020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.910020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.069855] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 in Status: SUCCESS [ 770.070094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.070631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.071025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.071108] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.071183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.071230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.072098] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.072098] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.072098] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.072098] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a11f256f-0ee8-49eb-88ef-2d544feb1609',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.080374] env[66854]: INFO networking_nsxv3.common.synchronization [None req-64b01d6d-7c51-420f-8226-4e59c1a7361b tempest-ServerActionsTestOtherB-456566424 tempest-ServerActionsTestOtherB-456566424-project-member] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 770.081132] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 770.081436] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.081548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.436388] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.436784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.436784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.436784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.436991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.436991] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 already deleted. [ 770.437293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.437293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.437352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.437435] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.582407] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f256f-0ee8-49eb-88ef-2d544feb1609 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.582407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.582407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.582407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.582407] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.582407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.582407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.582862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.582862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.582862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.582862] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f256f-0ee8-49eb-88ef-2d544feb1609 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.582986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.582986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.583648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.583648] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.583878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.583878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.584557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.586713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.586884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.586993] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a11f256f-0ee8-49eb-88ef-2d544feb1609',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.963367] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.963505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.963580] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.963848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.963913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.963964] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 already deleted. [ 770.964057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.048094] env[66854]: INFO networking_nsxv3.common.synchronization [None req-40d3abef-25af-42c5-a31f-92fced3977fc None None] Enqueued Resource ID: 90b2d088-02ac-45d2-ad8a-627c908ae7ec with Priority: HIGHEST for action port [ 771.049051] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b2d088-02ac-45d2-ad8a-627c908ae7ec with Priority: HIGHEST for action port [ 771.049486] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-90b2d088-02ac-45d2-ad8a-627c908ae7ec taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.049659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90b2d088-02ac-45d2-ad8a-627c908ae7ec" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.049702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90b2d088-02ac-45d2-ad8a-627c908ae7ec" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.049958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90b2d088-02ac-45d2-ad8a-627c908ae7ec" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.050056] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90b2d088-02ac-45d2-ad8a-627c908ae7ec',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.089315] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a11f256f-0ee8-49eb-88ef-2d544feb1609: rpc.has_security_group_logging(os_id): False [ 771.111677] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.111677] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.111677] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.111677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.112920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.112920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.113740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.113740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.114159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.114628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.114628] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 is going to be created. [ 771.190503] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.190503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.190503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.190503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.190503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.207031] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 in Status: IN_PROGRESS for 2s [ 771.553822] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90b2d088-02ac-45d2-ad8a-627c908ae7ec [ 771.554164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.554335] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.554374] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.554998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.554998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.554998] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90b2d088-02ac-45d2-ad8a-627c908ae7ec already deleted. [ 771.554998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90b2d088-02ac-45d2-ad8a-627c908ae7ec" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.875313] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: SUCCESS [ 771.875505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.662539] env[66854]: INFO networking_nsxv3.common.synchronization [req-a101090d-6531-4d27-82ac-31c98c088d1e req-09632451-0769-425f-885a-6e8f771264ad tempest-ListServersNegativeTestJSON-1804165574 tempest-ListServersNegativeTestJSON-1804165574-project-member] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 772.663090] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 772.663402] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.663519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.663586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.663777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.663934] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.664123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.664194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.664345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.664433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.664525] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.167713] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.222229] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 in Status: SUCCESS [ 773.222804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.674482] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.948576] env[66854]: INFO networking_nsxv3.common.synchronization [None req-59a572a6-cf6a-498b-9f0d-9e6e6e202d0c None None] Enqueued Resource ID: 221b61b6-0731-4dae-94c2-b246b5c46da1 with Priority: HIGHEST for action port [ 773.951414] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 221b61b6-0731-4dae-94c2-b246b5c46da1 with Priority: HIGHEST for action port [ 773.951414] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-221b61b6-0731-4dae-94c2-b246b5c46da1 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.951414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-221b61b6-0731-4dae-94c2-b246b5c46da1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.951414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-221b61b6-0731-4dae-94c2-b246b5c46da1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.951414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-221b61b6-0731-4dae-94c2-b246b5c46da1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.951414] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('221b61b6-0731-4dae-94c2-b246b5c46da1',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.177180] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.177411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.177411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.177598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.177598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.177752] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be updated. [ 774.234630] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.235077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.235077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.236186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.236186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.247780] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 774.382997] env[66854]: INFO networking_nsxv3.common.synchronization [req-699f94f9-39fa-4bb8-bc29-4ef1afafbdf3 req-b4c25569-c6ef-46f8-9401-ff3be3c91198 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 774.383698] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 774.384027] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.384167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.384237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.384445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.384602] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.384703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.384764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.384913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.385030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.385138] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.454902] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 221b61b6-0731-4dae-94c2-b246b5c46da1 [ 774.454902] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.454902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.454902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.454902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.454902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.454902] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:221b61b6-0731-4dae-94c2-b246b5c46da1 already deleted. [ 774.454902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-221b61b6-0731-4dae-94c2-b246b5c46da1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.674498] env[66854]: INFO networking_nsxv3.common.synchronization [None req-a00d6a56-5a63-406a-a3c2-efe8325ff133 None None] Enqueued Resource ID: 8ed6a67d-cacd-42a4-99bc-5d337da36afb with Priority: HIGHEST for action port [ 774.674912] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ed6a67d-cacd-42a4-99bc-5d337da36afb with Priority: HIGHEST for action port [ 774.675431] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ed6a67d-cacd-42a4-99bc-5d337da36afb taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.675431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ed6a67d-cacd-42a4-99bc-5d337da36afb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.675547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ed6a67d-cacd-42a4-99bc-5d337da36afb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.677317] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ed6a67d-cacd-42a4-99bc-5d337da36afb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.677317] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ed6a67d-cacd-42a4-99bc-5d337da36afb',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.887216] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.998492] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-312 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.998916] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-312" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.999058] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-312" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.999332] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-312" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.999665] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.999855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.999855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.000153] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.000292] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.000498] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.000605] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.000708] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.000810] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.000945] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.001017] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.001186] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.022350] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.022519] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.022660] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.022835] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-312" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.023245] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-9bef4d73-953b-40d9-887e-593d0ec6e5b3 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.023427] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.023542] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.023861] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.023997] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bef4d73-953b-40d9-887e-593d0ec6e5b3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.184720] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ed6a67d-cacd-42a4-99bc-5d337da36afb [ 775.184957] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.185109] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.185183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.185395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.185486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.185580] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ed6a67d-cacd-42a4-99bc-5d337da36afb already deleted. [ 775.185662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ed6a67d-cacd-42a4-99bc-5d337da36afb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.393498] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.526725] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.526990] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.527148] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.527429] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.527574] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.527724] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 9bef4d73-953b-40d9-887e-593d0ec6e5b3 not found, creating... [ 775.527972] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.528136] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.528245] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.528484] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.528631] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.528948] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.529137] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.529238] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.529469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.529600] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.529734] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 9bef4d73-953b-40d9-887e-593d0ec6e5b3 is going to be created. [ 775.550303] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.550574] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.550697] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.550988] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.551248] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.551464] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.898036] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.898036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.898036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.898036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.898036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.898036] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 775.932166] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.932166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.932166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.932166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.932468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.944173] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 776.259146] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 4s [ 776.275765] env[66854]: INFO networking_nsxv3.common.synchronization [None req-adb61113-e14e-401b-89d1-c853c7a3b719 None None] Enqueued Resource ID: 4d58e5b7-4326-4f10-90d5-c8843d943592 with Priority: HIGHEST for action port [ 776.276425] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d58e5b7-4326-4f10-90d5-c8843d943592 with Priority: HIGHEST for action port [ 776.276752] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d58e5b7-4326-4f10-90d5-c8843d943592 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.276969] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d58e5b7-4326-4f10-90d5-c8843d943592" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.277193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d58e5b7-4326-4f10-90d5-c8843d943592" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.277493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d58e5b7-4326-4f10-90d5-c8843d943592" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.277620] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d58e5b7-4326-4f10-90d5-c8843d943592',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.351955] env[66854]: INFO networking_nsxv3.common.synchronization [req-699f94f9-39fa-4bb8-bc29-4ef1afafbdf3 req-8f59601e-0df1-4f35-8635-242f0dde1096 service nova] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 776.351955] env[66854]: INFO networking_nsxv3.common.synchronization [req-699f94f9-39fa-4bb8-bc29-4ef1afafbdf3 req-8f59601e-0df1-4f35-8635-242f0dde1096 service nova] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 776.351955] env[66854]: INFO networking_nsxv3.common.synchronization [req-699f94f9-39fa-4bb8-bc29-4ef1afafbdf3 req-8f59601e-0df1-4f35-8635-242f0dde1096 service nova] Enqueued Resource ID: 9bef4d73-953b-40d9-887e-593d0ec6e5b3 with Priority: HIGHEST for action port [ 776.353255] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 776.353409] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 776.353619] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bef4d73-953b-40d9-887e-593d0ec6e5b3 with Priority: HIGHEST for action port [ 776.355764] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.355980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.356360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.356732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.357558] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.359233] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.359233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.359849] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bef4d73-953b-40d9-887e-593d0ec6e5b3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.359849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.359849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.362719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.362719] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bef4d73-953b-40d9-887e-593d0ec6e5b3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.655681] env[66854]: INFO networking_nsxv3.common.synchronization [req-d7f6680c-68e4-4f33-b9e8-efcc6701cacd req-489716f1-da10-4142-88d3-bbf91bf54958 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 776.656433] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 776.656790] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.656947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.657056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.657273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.657435] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.657537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.657603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.657761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.657845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.657945] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.666558] env[66854]: INFO networking_nsxv3.common.synchronization [None req-385f42ff-0883-4691-b2b7-e9687d7a6579 None None] Enqueued Resource ID: e6d82376-162f-4225-87a3-affff4e8027b with Priority: HIGHEST for action port [ 776.668555] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d82376-162f-4225-87a3-affff4e8027b with Priority: HIGHEST for action port [ 776.668555] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6d82376-162f-4225-87a3-affff4e8027b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.668555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6d82376-162f-4225-87a3-affff4e8027b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.668555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6d82376-162f-4225-87a3-affff4e8027b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.668984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6d82376-162f-4225-87a3-affff4e8027b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.668984] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6d82376-162f-4225-87a3-affff4e8027b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.781698] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d58e5b7-4326-4f10-90d5-c8843d943592 [ 776.782458] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.782792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.782963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.784450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.784450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.784450] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d58e5b7-4326-4f10-90d5-c8843d943592 already deleted. [ 776.784450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d58e5b7-4326-4f10-90d5-c8843d943592" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.863298] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.863298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.863957] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bef4d73-953b-40d9-887e-593d0ec6e5b3 with status ACTIVE [ 776.865028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.865028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.865028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.865028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.865028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.865028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.865028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.865028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.865477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.865477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.865477] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.865594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.865594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.865742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.865791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.865859] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bef4d73-953b-40d9-887e-593d0ec6e5b3 is going to be updated. [ 776.893330] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.893330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.893330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.893330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.893507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.893667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.161963] env[66854]: INFO networking_nsxv3.common.synchronization [req-5fd5ae07-d9ac-45ca-b49b-d117a5db932d req-c9fa8f65-5c8f-4b43-a19b-5a4f57ffbb58 tempest-ServersAdminNegativeTestJSON-44301001 tempest-ServersAdminNegativeTestJSON-44301001-project-member] Enqueued Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 777.162415] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.162555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.162667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.162782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.162868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.163843] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.164696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.164837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.166739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.166739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.166739] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 777.167957] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 777.168559] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.168662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.168728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.168897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.171254] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.171254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.171254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.171254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.171254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.171254] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.171877] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6d82376-162f-4225-87a3-affff4e8027b [ 777.172053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.172163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.172888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.172888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.172888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.172888] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6d82376-162f-4225-87a3-affff4e8027b already deleted. [ 777.172888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6d82376-162f-4225-87a3-affff4e8027b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.222134] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.222395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.222395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.223509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.223509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.239664] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 777.618995] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.619251] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.619319] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.619527] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.619842] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.619958] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.620090] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.620307] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.620465] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.620677] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.620785] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.620886] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.621049] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.621293] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.621293] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.621438] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.644579] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.644830] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.644830] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.644973] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.645281] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-3576e76c-1cb1-4f6f-8731-fef31c80aabd taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.645469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-3576e76c-1cb1-4f6f-8731-fef31c80aabd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.645914] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-3576e76c-1cb1-4f6f-8731-fef31c80aabd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.645914] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-3576e76c-1cb1-4f6f-8731-fef31c80aabd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.646085] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3576e76c-1cb1-4f6f-8731-fef31c80aabd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.672734] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.958847] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 777.958847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.958847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.958847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.958847] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.958847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.958847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.958847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.958847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.958847] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.150280] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.150280] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.150280] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.150280] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.150280] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.150280] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 3576e76c-1cb1-4f6f-8731-fef31c80aabd not found, creating... [ 778.150280] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.150737] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.150737] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.150737] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.150827] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.151589] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.151784] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.151899] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.152127] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.152264] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.152402] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 3576e76c-1cb1-4f6f-8731-fef31c80aabd is going to be created. [ 778.175490] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.175916] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.175916] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.176271] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.176950] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.176950] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-3576e76c-1cb1-4f6f-8731-fef31c80aabd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.177505] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.272070] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 778.272070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.460326] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.680823] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.681046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.681046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.681348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.681445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.681570] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e is going to be updated. [ 778.715387] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.715387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.715387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.715387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.715387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.753454] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: IN_PROGRESS for 2s [ 778.893032] env[66854]: INFO networking_nsxv3.common.synchronization [req-46330b72-97dc-4e0f-9cdf-421b6cb27030 req-e6f05b4f-962c-4e16-9d33-ace150066b0e tempest-ImagesOneServerNegativeTestJSON-1585579513 tempest-ImagesOneServerNegativeTestJSON-1585579513-project-member] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 778.893510] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 778.893875] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.894093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.894166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.894437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.894704] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.894823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.894891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.895152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.895288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.895464] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.922136] env[66854]: INFO networking_nsxv3.common.synchronization [req-5fd5ae07-d9ac-45ca-b49b-d117a5db932d req-83a2a1e0-19f1-42f7-9bdf-3af8fe1b8207 service nova] Enqueued Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_rules [ 778.922477] env[66854]: INFO networking_nsxv3.common.synchronization [req-5fd5ae07-d9ac-45ca-b49b-d117a5db932d req-83a2a1e0-19f1-42f7-9bdf-3af8fe1b8207 service nova] Enqueued Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 778.922619] env[66854]: INFO networking_nsxv3.common.synchronization [req-5fd5ae07-d9ac-45ca-b49b-d117a5db932d req-83a2a1e0-19f1-42f7-9bdf-3af8fe1b8207 service nova] Enqueued Resource ID: 3576e76c-1cb1-4f6f-8731-fef31c80aabd with Priority: HIGHEST for action port [ 778.923662] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_rules [ 778.923915] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 778.924185] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3576e76c-1cb1-4f6f-8731-fef31c80aabd with Priority: HIGHEST for action port [ 778.924616] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.924831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.925061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.925643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.925643] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.928653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.928840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.929218] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3576e76c-1cb1-4f6f-8731-fef31c80aabd taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.929446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3576e76c-1cb1-4f6f-8731-fef31c80aabd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.929572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3576e76c-1cb1-4f6f-8731-fef31c80aabd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.930235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3576e76c-1cb1-4f6f-8731-fef31c80aabd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.930235] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3576e76c-1cb1-4f6f-8731-fef31c80aabd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.963632] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.251353] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 779.252545] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 deletion is rescheduled due to dependency. [ 779.252545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.358342] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.358520] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.358640] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.358964] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.359309] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.359466] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.359633] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.359974] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.360037] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.360272] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.360391] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.360500] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.360597] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.360674] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.360774] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.360897] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.380854] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.381049] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 779.381225] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.381363] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.381703] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-c6dd600d-b32d-415f-a2ec-a7c78cef71ac taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.381875] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-c6dd600d-b32d-415f-a2ec-a7c78cef71ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.382027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-c6dd600d-b32d-415f-a2ec-a7c78cef71ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.382366] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-c6dd600d-b32d-415f-a2ec-a7c78cef71ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.382504] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6dd600d-b32d-415f-a2ec-a7c78cef71ac',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.398471] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.398471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.398471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.398471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.398471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.399342] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.399342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.399342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.399342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.399342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.399342] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce already deleted. [ 779.399342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.435179] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.435311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.437379] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3576e76c-1cb1-4f6f-8731-fef31c80aabd with status ACTIVE [ 779.437379] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.437379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.437379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.437379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.437379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.437379] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.437379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.437379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.437952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.437952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.437952] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.437952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.437952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.438133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.438179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.440414] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3576e76c-1cb1-4f6f-8731-fef31c80aabd is going to be updated. [ 779.466911] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.467192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.467192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.467381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.467509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.467642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3576e76c-1cb1-4f6f-8731-fef31c80aabd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.467980] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.468095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.468162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.468384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.468463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.468551] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 779.499977] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.500145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.500221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.500558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.503698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.513858] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 779.885927] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.885927] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.885927] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.886255] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.886255] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.886366] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port c6dd600d-b32d-415f-a2ec-a7c78cef71ac not found, creating... [ 779.887046] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.887046] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.887046] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.887291] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.887291] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.887499] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.887649] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.887759] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.887968] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.888128] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.888260] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: c6dd600d-b32d-415f-a2ec-a7c78cef71ac is going to be created. [ 779.910063] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.910063] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.910063] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.910362] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.910514] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.910737] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-c6dd600d-b32d-415f-a2ec-a7c78cef71ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.633999] env[66854]: INFO networking_nsxv3.common.synchronization [req-46330b72-97dc-4e0f-9cdf-421b6cb27030 req-eefa7cde-b7e2-4ab0-91d3-d234e98ce55c service nova] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_rules [ 780.633999] env[66854]: INFO networking_nsxv3.common.synchronization [req-46330b72-97dc-4e0f-9cdf-421b6cb27030 req-eefa7cde-b7e2-4ab0-91d3-d234e98ce55c service nova] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 780.634245] env[66854]: INFO networking_nsxv3.common.synchronization [req-46330b72-97dc-4e0f-9cdf-421b6cb27030 req-eefa7cde-b7e2-4ab0-91d3-d234e98ce55c service nova] Enqueued Resource ID: c6dd600d-b32d-415f-a2ec-a7c78cef71ac with Priority: HIGHEST for action port [ 780.634318] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_rules [ 780.634449] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 780.634547] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6dd600d-b32d-415f-a2ec-a7c78cef71ac with Priority: HIGHEST for action port [ 780.637337] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.637477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.637709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.637991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.638097] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.638932] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.639061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.639249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.639612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.639612] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.639612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.639612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.639876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.639876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.639936] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.641367] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6dd600d-b32d-415f-a2ec-a7c78cef71ac taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.641367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6dd600d-b32d-415f-a2ec-a7c78cef71ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.641367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6dd600d-b32d-415f-a2ec-a7c78cef71ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.641367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6dd600d-b32d-415f-a2ec-a7c78cef71ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.642288] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6dd600d-b32d-415f-a2ec-a7c78cef71ac',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.768045] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: SUCCESS [ 780.768357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.769041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.769041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.769243] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.769243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.769403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.769506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.769568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.769667] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.145975] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.145975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.145975] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.145975] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6dd600d-b32d-415f-a2ec-a7c78cef71ac with status ACTIVE [ 781.146448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.146448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.146448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.146557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.146557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.147186] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.147186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.147186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.147186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.147186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.147442] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.147545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.147624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.147807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.147927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.148139] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6dd600d-b32d-415f-a2ec-a7c78cef71ac is going to be updated. [ 781.171299] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.171448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.171523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.171815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.171991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.172627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6dd600d-b32d-415f-a2ec-a7c78cef71ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.274155] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.526219] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 781.526483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.526675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.526968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.527307] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.527458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.527529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.527703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.527784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.527872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.527966] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.650578] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.776306] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.030573] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.030788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.030788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.031037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.031206] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.031332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.031391] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.031547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.031636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.031725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.031889] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.031983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.032055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.032214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.032376] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.032470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.032525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.032662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.032750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.032832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.032926] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.156065] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.156065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.156065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.156065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.156065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.156065] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be created. [ 782.184442] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.184632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.184723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.184948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.185206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.215122] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: UNINITIALIZED for 2s [ 782.286801] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.286801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.286801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.286801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.286801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.286801] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e is going to be updated. [ 782.334196] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.334196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.334307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.335019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.335019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.358029] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: IN_PROGRESS for 2s [ 782.535423] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87b57f10-d9c1-422b-ae4f-428ffd202f74: rpc.has_security_group_logging(os_id): False [ 782.554098] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.554257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.554780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.554780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.554780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.554935] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.554935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.554935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.555111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.555180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.555385] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.555477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.555531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.555728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.555811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.555958] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.556745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.556902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.557089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.557184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.557282] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 782.625112] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.625363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.625363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.625563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.625711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.661703] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 784.257600] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 784.257867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.258064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.258307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.258506] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.258624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.258687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.258843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.258924] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.259021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.259119] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.368347] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: SUCCESS [ 784.368702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.368782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.368945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.369151] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.369832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.369832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.369832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.369832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.369832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.369832] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.683039] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 784.683039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.765412] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.765412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.765412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.765412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.765412] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.765412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.765412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.765412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.765412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.765412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.765995] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.765995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.765995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.765995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.765995] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.765995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.766484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.766484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.766484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.766484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.766484] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.872549] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.872729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.872729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.873763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.873763] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.873763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.873763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.873763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.873763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.873763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.873763] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.874085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.874085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.874085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.874337] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.874337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.874337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.874479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.874509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.874634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.874753] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.269592] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc128a33-d808-470d-8d77-03637a1be1ce: rpc.has_security_group_logging(os_id): False [ 785.291245] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.291480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.291480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.291674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.291766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.291959] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.292069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.292132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.292282] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.292359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.292543] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.292667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.292719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.292833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.292909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.293122] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.293441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.293441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.293441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.293525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.293627] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be created. [ 785.362048] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.362048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.362048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.362048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.362048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.372733] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 785.378421] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b4083ca-5955-4d5e-bfa3-13977c48a75e: rpc.has_security_group_logging(os_id): False [ 785.400860] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.401078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.401184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.401522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.401641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.401915] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.402043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.402105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.402284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.402363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.402591] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.402783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.402783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.402885] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.402957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.403605] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.403723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.404212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.404212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.404212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.404364] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e is going to be updated. [ 785.505397] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.505397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.505397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.505397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.505397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.525169] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: IN_PROGRESS for 2s [ 785.636984] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 785.636984] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 786.190893] env[66854]: INFO networking_nsxv3.common.synchronization [req-51509141-62c3-4b4f-b31d-a5746a1a9ff4 req-1cdc205a-652e-4fdb-8edf-1d03d08ffff3 tempest-ServersAdminTestJSON-1278843131 tempest-ServersAdminTestJSON-1278843131-project-member] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 786.191634] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 786.192167] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.192301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.192385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.192681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.192860] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.192965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.193044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.193322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.193419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.193830] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.696085] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.831989] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.832232] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.832374] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.832653] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.832932] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.833522] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.833675] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.833987] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.834159] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.834945] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.835101] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.835424] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.835576] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.835695] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.835802] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.835930] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.856112] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.856303] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.856442] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.856612] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-237" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.856931] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.857198] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.857256] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.857631] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.857778] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.199057] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.359828] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.360077] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.360200] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.360479] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.360624] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.360934] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d not found, creating... [ 787.361045] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.361202] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.361314] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.361537] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.361668] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.362074] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.362166] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.362471] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.362534] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.362632] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.362763] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d is going to be created. [ 787.392772] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 787.394167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.395437] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.395711] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.395843] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.396577] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.396865] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.397151] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.545755] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: SUCCESS [ 787.545846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.585026] env[66854]: INFO networking_nsxv3.common.synchronization [None req-44c16011-97d8-4a7b-a73b-3c18b7d0ab96 None None] Enqueued Resource ID: d5fd1209-3b46-4895-8b4a-0690db153b41 with Priority: HIGHEST for action port [ 787.585026] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fd1209-3b46-4895-8b4a-0690db153b41 with Priority: HIGHEST for action port [ 787.585026] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5fd1209-3b46-4895-8b4a-0690db153b41 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.585026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5fd1209-3b46-4895-8b4a-0690db153b41" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.585026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5fd1209-3b46-4895-8b4a-0690db153b41" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.585026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5fd1209-3b46-4895-8b4a-0690db153b41" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.585026] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5fd1209-3b46-4895-8b4a-0690db153b41',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.702234] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.702615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.702615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.702694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.702794] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.702925] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 787.738293] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.738293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.738513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.738608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.738733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.747524] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 788.089257] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5fd1209-3b46-4895-8b4a-0690db153b41 [ 788.089257] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.089257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.089257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.089257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.089257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.089257] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5fd1209-3b46-4895-8b4a-0690db153b41 already deleted. [ 788.089257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5fd1209-3b46-4895-8b4a-0690db153b41" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.191858] env[66854]: INFO networking_nsxv3.common.synchronization [req-51509141-62c3-4b4f-b31d-a5746a1a9ff4 req-a1e93976-163b-4281-a9a3-dd7d56054400 service nova] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_rules [ 788.191858] env[66854]: INFO networking_nsxv3.common.synchronization [req-51509141-62c3-4b4f-b31d-a5746a1a9ff4 req-a1e93976-163b-4281-a9a3-dd7d56054400 service nova] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 788.191858] env[66854]: INFO networking_nsxv3.common.synchronization [req-51509141-62c3-4b4f-b31d-a5746a1a9ff4 req-a1e93976-163b-4281-a9a3-dd7d56054400 service nova] Enqueued Resource ID: 16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d with Priority: HIGHEST for action port [ 788.192864] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_rules [ 788.192864] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 788.193014] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d with Priority: HIGHEST for action port [ 788.193656] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.193656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.193656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.193979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.194276] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.195276] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.195491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.195605] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.195708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.195819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.195965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.198186] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.701944] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.702158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.702670] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d with status ACTIVE [ 788.703031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.703031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.703031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.704276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.704276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.704276] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.704276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.704276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.710536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.710536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.710536] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.710536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.710536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.710536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.710536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.710536] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d is going to be updated. [ 788.736348] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.736348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.736348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.736348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.736348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.736348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16cd4fb2-c187-4a33-9b00-bfd2bd0ea40d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.766871] env[66854]: INFO networking_nsxv3.common.synchronization [req-da1dfe36-dbc2-4cfe-bddb-4104e9248e0f req-4ff80f72-7917-4a72-81cd-242b770e28ae tempest-TenantUsagesTestJSON-1057132391 tempest-TenantUsagesTestJSON-1057132391-project-member] Enqueued Resource ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 with Priority: HIGHEST for action security_group_members [ 788.767684] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 with Priority: HIGHEST for action security_group_members [ 788.767871] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bfd71e-0706-4e38-94f5-8c8814c273e6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.767958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.768325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.768744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.769185] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.769310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.769587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.770135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.770313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.770390] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8bfd71e-0706-4e38-94f5-8c8814c273e6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.171022] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.171754] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.171754] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.171754] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.171990] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.172086] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.172258] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.172388] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.172524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.172730] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.172840] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.172942] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.173684] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.173684] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.173684] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.173684] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.195812] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.195812] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 789.195812] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.195812] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.195812] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-80043053-94b1-4378-bde1-ef619ea7cf9b taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.195812] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-80043053-94b1-4378-bde1-ef619ea7cf9b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.195812] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-80043053-94b1-4378-bde1-ef619ea7cf9b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.195812] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-80043053-94b1-4378-bde1-ef619ea7cf9b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.195812] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80043053-94b1-4378-bde1-ef619ea7cf9b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.272737] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.273875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.274061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.274326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.274819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.274819] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.274819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.274819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.275057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.275057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.275146] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 already deleted. [ 789.275189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.700339] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.700550] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.700674] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.700988] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.701150] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.701300] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 80043053-94b1-4378-bde1-ef619ea7cf9b not found, creating... [ 789.701555] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.701805] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.701805] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.702748] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.702748] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.702748] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.702748] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.702748] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.703180] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.703180] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.703180] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 80043053-94b1-4378-bde1-ef619ea7cf9b is going to be created. [ 789.728101] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.728101] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.728101] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.728348] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.728540] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.728819] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-80043053-94b1-4378-bde1-ef619ea7cf9b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.757542] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 789.757817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.757817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.758404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.758404] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.758404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.758575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.758605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.758694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.759074] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.119269] env[66854]: INFO networking_nsxv3.common.synchronization [None req-71c932e8-1a18-4bac-af40-e679fe9e08c7 None None] Enqueued Resource ID: de2d83b4-5a32-44d4-a970-6a65b909b8a9 with Priority: HIGHEST for action port [ 790.119925] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2d83b4-5a32-44d4-a970-6a65b909b8a9 with Priority: HIGHEST for action port [ 790.120180] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-de2d83b4-5a32-44d4-a970-6a65b909b8a9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.120297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de2d83b4-5a32-44d4-a970-6a65b909b8a9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.120367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de2d83b4-5a32-44d4-a970-6a65b909b8a9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.124464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de2d83b4-5a32-44d4-a970-6a65b909b8a9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.124464] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de2d83b4-5a32-44d4-a970-6a65b909b8a9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.263508] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.445106] env[66854]: INFO networking_nsxv3.common.synchronization [req-da1dfe36-dbc2-4cfe-bddb-4104e9248e0f req-2bc7c477-d65d-42cd-817c-2cba8e1caf9a service nova] Enqueued Resource ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 with Priority: HIGHEST for action security_group_rules [ 790.445335] env[66854]: INFO networking_nsxv3.common.synchronization [req-da1dfe36-dbc2-4cfe-bddb-4104e9248e0f req-2bc7c477-d65d-42cd-817c-2cba8e1caf9a service nova] Enqueued Resource ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 with Priority: HIGHEST for action security_group_members [ 790.445495] env[66854]: INFO networking_nsxv3.common.synchronization [req-da1dfe36-dbc2-4cfe-bddb-4104e9248e0f req-2bc7c477-d65d-42cd-817c-2cba8e1caf9a service nova] Enqueued Resource ID: 80043053-94b1-4378-bde1-ef619ea7cf9b with Priority: HIGHEST for action port [ 790.446015] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 with Priority: HIGHEST for action security_group_rules [ 790.446179] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 with Priority: HIGHEST for action security_group_members [ 790.446277] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80043053-94b1-4378-bde1-ef619ea7cf9b with Priority: HIGHEST for action port [ 790.446550] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8bfd71e-0706-4e38-94f5-8c8814c273e6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.446680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.446746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.447008] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.447838] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8bfd71e-0706-4e38-94f5-8c8814c273e6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.449064] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bfd71e-0706-4e38-94f5-8c8814c273e6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.449228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.449333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.449581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.449784] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.449961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.450072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.450287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.450437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.450558] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8bfd71e-0706-4e38-94f5-8c8814c273e6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.451435] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-80043053-94b1-4378-bde1-ef619ea7cf9b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.451595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80043053-94b1-4378-bde1-ef619ea7cf9b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.451723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80043053-94b1-4378-bde1-ef619ea7cf9b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.451937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80043053-94b1-4378-bde1-ef619ea7cf9b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.452051] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80043053-94b1-4378-bde1-ef619ea7cf9b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.626914] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de2d83b4-5a32-44d4-a970-6a65b909b8a9 [ 790.627627] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.627762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.627850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.628122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.628213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.628311] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de2d83b4-5a32-44d4-a970-6a65b909b8a9 already deleted. [ 790.628392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de2d83b4-5a32-44d4-a970-6a65b909b8a9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.765505] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.953524] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8bfd71e-0706-4e38-94f5-8c8814c273e6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.957149] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bfd71e-0706-4e38-94f5-8c8814c273e6 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.957149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.959029] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80043053-94b1-4378-bde1-ef619ea7cf9b with status ACTIVE [ 790.959228] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.959369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.959441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.959645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.959733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.959915] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.960071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.960104] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.960250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.960325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.960519] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.960609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.960666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.960945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.960945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.961107] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80043053-94b1-4378-bde1-ef619ea7cf9b is going to be updated. [ 790.990666] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.990819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.990941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.991189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.991351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.991849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80043053-94b1-4378-bde1-ef619ea7cf9b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.270193] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.270193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.270193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.270193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.270193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.270193] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 791.305977] env[66854]: INFO networking_nsxv3.common.synchronization [None req-0c0a6fab-ad36-45a4-8730-c78102a857bd tempest-ServerActionsV293TestJSON-908997761 tempest-ServerActionsV293TestJSON-908997761-project-member] Enqueued Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_rules [ 791.308951] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.309105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.309224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.309439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.309592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.312698] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_rules [ 791.312698] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.312698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.312698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.313031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.313088] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.325221] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 791.404482] env[66854]: INFO networking_nsxv3.common.synchronization [None req-ddc6c3f1-5127-4845-b3b7-f2fc121cb47c tempest-ServerActionsV293TestJSON-908997761 tempest-ServerActionsV293TestJSON-908997761-project-member] Enqueued Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_rules [ 791.405245] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_rules [ 791.405692] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.405951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.462254] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8bfd71e-0706-4e38-94f5-8c8814c273e6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.565055] env[66854]: INFO networking_nsxv3.common.synchronization [req-2d954bb5-2268-4088-a5f9-7d14cef498dc req-547a3030-65b7-4c6e-8353-f74d64dab3ba tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 791.565055] env[66854]: INFO networking_nsxv3.common.synchronization [req-2d954bb5-2268-4088-a5f9-7d14cef498dc req-547a3030-65b7-4c6e-8353-f74d64dab3ba tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_members [ 791.565055] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 791.565055] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_members [ 791.566259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.566582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.566745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.567061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.567324] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.567552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.567746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.568115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.568313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.568503] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.570055] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e609d95d-5be9-41f5-b37f-2462907e2f6a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.570750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.570750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.571276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.573059] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.573059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.573059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.573059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.573059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.573059] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.622941] env[66854]: INFO networking_nsxv3.common.synchronization [req-2d954bb5-2268-4088-a5f9-7d14cef498dc req-547a3030-65b7-4c6e-8353-f74d64dab3ba tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 791.622941] env[66854]: INFO networking_nsxv3.common.synchronization [req-2d954bb5-2268-4088-a5f9-7d14cef498dc req-547a3030-65b7-4c6e-8353-f74d64dab3ba tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 791.622941] env[66854]: INFO networking_nsxv3.common.synchronization [req-2d954bb5-2268-4088-a5f9-7d14cef498dc req-547a3030-65b7-4c6e-8353-f74d64dab3ba tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_rules [ 791.622941] env[66854]: INFO networking_nsxv3.common.synchronization [req-2d954bb5-2268-4088-a5f9-7d14cef498dc req-547a3030-65b7-4c6e-8353-f74d64dab3ba tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_members [ 791.622941] env[66854]: INFO networking_nsxv3.common.synchronization [req-2d954bb5-2268-4088-a5f9-7d14cef498dc req-547a3030-65b7-4c6e-8353-f74d64dab3ba tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 9bef4d73-953b-40d9-887e-593d0ec6e5b3 with Priority: HIGHEST for action port [ 791.622941] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 791.622941] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_rules [ 791.622941] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bef4d73-953b-40d9-887e-593d0ec6e5b3 with Priority: HIGHEST for action port [ 791.623381] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 791.623726] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_members [ 791.624217] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.624487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.624645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.624941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.625146] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.626562] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e609d95d-5be9-41f5-b37f-2462907e2f6a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.626855] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.627036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.627372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.627547] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.628484] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bef4d73-953b-40d9-887e-593d0ec6e5b3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.632082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.632082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.632082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.632082] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bef4d73-953b-40d9-887e-593d0ec6e5b3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.632082] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.632082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.632082] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e609d95d-5be9-41f5-b37f-2462907e2f6a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.632082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.842765] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.843446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.843446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.843446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.843446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.843446] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 already deleted. [ 791.843610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.843640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.843894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.843894] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.964385] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.964572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.964572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.964760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.964985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.964985] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 is going to be created. [ 791.992377] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.992555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.992656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.993220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.993220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.007912] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 in Status: UNINITIALIZED for 2s [ 792.076083] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.076083] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.131305] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.131460] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.131631] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bef4d73-953b-40d9-887e-593d0ec6e5b3 with status ACTIVE [ 792.132205] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.132205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.132205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.132205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.132389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.133158] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.133158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.133158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.133158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.133158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.133158] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.133158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.133468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.133468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.133468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.133468] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bef4d73-953b-40d9-887e-593d0ec6e5b3 is going to be updated. [ 792.138973] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e609d95d-5be9-41f5-b37f-2462907e2f6a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.139100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.165430] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.165650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.165650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.165915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.166744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.166744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.388543] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.388809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.388809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.389083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.389203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.389307] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 already deleted. [ 792.389436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.579193] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.580063] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.082520] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.083094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.083200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.083535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.083535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.083663] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e609d95d-5be9-41f5-b37f-2462907e2f6a is going to be created. [ 793.089929] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.090825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.090825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.090825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.090825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.090825] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 793.131782] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.132062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.135815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.135955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.137108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.142064] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.142236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.143032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.143032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.143032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.151949] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: UNINITIALIZED for 2s [ 793.154231] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 793.362088] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 793.362440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.363313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.363574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.364089] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.364241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.364316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.364527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.364627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.364698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.364802] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.867429] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.867579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.867654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.867893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.868274] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.868391] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.868456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.868632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.868714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.868815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.868956] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.869071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.869134] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.869281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.869422] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.869512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.869571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.869706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.869781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.869863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.869954] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.019899] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 in Status: SUCCESS [ 794.021167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.021429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.021666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.021878] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.021992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.022085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.022291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.022358] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.022407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.022538] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8bfd71e-0706-4e38-94f5-8c8814c273e6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.222843] env[66854]: INFO networking_nsxv3.common.synchronization [req-459d5738-a081-4e7b-aa64-fddeacc744c5 req-d334a922-4d5e-4b0a-9414-bc4f871fc804 tempest-ServersTestFqdnHostnames-796960008 tempest-ServersTestFqdnHostnames-796960008-project-member] Enqueued Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_members [ 794.223650] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_members [ 794.224054] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-db9d8667-c0a3-4930-8f4b-8672f1d358e9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.224239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.224408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.224737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.225048] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.225179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.225293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.225505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.225598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.225723] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.373108] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 404f4fa4-39e5-44f2-b930-0c5f5853142c: rpc.has_security_group_logging(os_id): False [ 794.399693] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.399693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.399693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.399693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.399693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.400176] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.400176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.400176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.400366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.400366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.404024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.404024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.404024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.404024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.404024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.404024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.404024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.404024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.404024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.404024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.404024] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 794.486107] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.486373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.486498] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.486795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.486970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.508540] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 794.530848] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bfd71e-0706-4e38-94f5-8c8814c273e6 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.530848] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.530848] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bfd71e-0706-4e38-94f5-8c8814c273e6 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.530848] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.530848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.532477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.532477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.532477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.532477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.532477] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8bfd71e-0706-4e38-94f5-8c8814c273e6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.696168] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.696360] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-705" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.696479] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-705" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.696843] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-705" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.698095] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.698339] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.698465] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.698735] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.698882] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.699125] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.699278] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.699379] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.699489] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.699593] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.699690] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.699837] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.721136] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.721345] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.721533] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.721639] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-705" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.721944] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-3443f634-79a9-4bd5-8f12-7f35ad7e5c1f taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.722124] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-3443f634-79a9-4bd5-8f12-7f35ad7e5c1f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.722470] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-3443f634-79a9-4bd5-8f12-7f35ad7e5c1f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.722697] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-3443f634-79a9-4bd5-8f12-7f35ad7e5c1f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.722697] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3443f634-79a9-4bd5-8f12-7f35ad7e5c1f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.728433] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.728658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.728658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.729578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.729695] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.729874] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.729976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.730051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.730291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.730395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.730711] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 already deleted. [ 794.730711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.938914] env[66854]: INFO networking_nsxv3.common.synchronization [None req-b9b6da85-c6a1-4773-9b22-add69bad8aa1 None None] Enqueued Resource ID: b9d5770d-bf31-4b04-8f8f-85ddadef1bc9 with Priority: HIGHEST for action port [ 794.943042] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d5770d-bf31-4b04-8f8f-85ddadef1bc9 with Priority: HIGHEST for action port [ 794.943042] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9d5770d-bf31-4b04-8f8f-85ddadef1bc9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.943042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9d5770d-bf31-4b04-8f8f-85ddadef1bc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.943042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9d5770d-bf31-4b04-8f8f-85ddadef1bc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.943042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9d5770d-bf31-4b04-8f8f-85ddadef1bc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.943042] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d5770d-bf31-4b04-8f8f-85ddadef1bc9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.034928] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8bfd71e-0706-4e38-94f5-8c8814c273e6: rpc.has_security_group_logging(os_id): False [ 795.062911] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.063216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.063324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.063933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.063933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.064252] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.064365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.064445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.065373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.065373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.065373] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.065373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.065373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.065838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.065838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.065959] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.066816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.066816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.066816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.066816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.066816] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 is going to be created. [ 795.170869] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.170869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.171646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.171950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.172370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.174505] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.185611] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: SUCCESS [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.185611] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.185611] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.185611] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.185611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.185611] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.200498] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 in Status: IN_PROGRESS for 2s [ 795.227135] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.227135] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.227135] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.227562] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.227562] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.227562] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 3443f634-79a9-4bd5-8f12-7f35ad7e5c1f not found, creating... [ 795.227837] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.227837] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.227993] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.228241] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.228412] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.228643] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.228966] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.228966] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.229275] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.229275] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.229457] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 3443f634-79a9-4bd5-8f12-7f35ad7e5c1f is going to be created. [ 795.258489] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.258706] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.258827] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.259132] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.259362] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.259591] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-3443f634-79a9-4bd5-8f12-7f35ad7e5c1f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.443420] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9d5770d-bf31-4b04-8f8f-85ddadef1bc9 [ 795.444808] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.444808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.444808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.444808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.444808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.444808] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9d5770d-bf31-4b04-8f8f-85ddadef1bc9 already deleted. [ 795.444808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9d5770d-bf31-4b04-8f8f-85ddadef1bc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.507355] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:0 completed [ 795.507540] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:1 started [ 795.684432] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.685562] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.043080] env[66854]: INFO networking_nsxv3.common.synchronization [req-459d5738-a081-4e7b-aa64-fddeacc744c5 req-0f70bea0-2f9b-4721-aaa1-c892e795616a service nova] Enqueued Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_rules [ 796.043564] env[66854]: INFO networking_nsxv3.common.synchronization [req-459d5738-a081-4e7b-aa64-fddeacc744c5 req-0f70bea0-2f9b-4721-aaa1-c892e795616a service nova] Enqueued Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_members [ 796.043781] env[66854]: INFO networking_nsxv3.common.synchronization [req-459d5738-a081-4e7b-aa64-fddeacc744c5 req-0f70bea0-2f9b-4721-aaa1-c892e795616a service nova] Enqueued Resource ID: 3443f634-79a9-4bd5-8f12-7f35ad7e5c1f with Priority: HIGHEST for action port [ 796.044879] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_rules [ 796.044953] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_members [ 796.045034] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3443f634-79a9-4bd5-8f12-7f35ad7e5c1f with Priority: HIGHEST for action port [ 796.045625] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.045748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.045802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.046704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.046704] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.049879] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-db9d8667-c0a3-4930-8f4b-8672f1d358e9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.050132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.050254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.055424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.056274] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.058183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.058183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.058183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.058183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.058183] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.059834] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3443f634-79a9-4bd5-8f12-7f35ad7e5c1f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.060149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3443f634-79a9-4bd5-8f12-7f35ad7e5c1f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.060149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3443f634-79a9-4bd5-8f12-7f35ad7e5c1f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.061727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3443f634-79a9-4bd5-8f12-7f35ad7e5c1f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.061727] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3443f634-79a9-4bd5-8f12-7f35ad7e5c1f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.188683] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.190412] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.528492] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 796.528492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.563587] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-db9d8667-c0a3-4930-8f4b-8672f1d358e9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.563846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.564299] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.565377] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3443f634-79a9-4bd5-8f12-7f35ad7e5c1f with status ACTIVE [ 796.566094] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.566251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.566316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.566545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.566616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.566962] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.567107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.567249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.567747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.567854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.568158] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.569324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.569324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.569324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.569324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.569324] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3443f634-79a9-4bd5-8f12-7f35ad7e5c1f is going to be updated. [ 796.593781] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.593781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.593781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.594478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.594898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.594977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3443f634-79a9-4bd5-8f12-7f35ad7e5c1f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.692278] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.692578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.692720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.692926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.693032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.693140] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e609d95d-5be9-41f5-b37f-2462907e2f6a is going to be updated. [ 796.694708] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.694840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.694979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.695241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.695349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.695452] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 796.735228] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.735228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.735448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.735546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.735733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.738034] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.738233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.738346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.738556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.738704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.758581] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: IN_PROGRESS for 2s [ 796.759499] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 797.071640] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.215486] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 in Status: SUCCESS [ 797.215486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.576595] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.576595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.576595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.576595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.576595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.576595] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 is going to be created. [ 797.608814] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.608814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.608814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.608814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.608814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.621290] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 in Status: UNINITIALIZED for 2s [ 798.298072] env[66854]: INFO networking_nsxv3.common.synchronization [None req-ddda03db-1be4-4810-aa18-9df7f32222ca None None] Enqueued Resource ID: dbba38e1-728f-4c48-ba68-4d60d734d33f with Priority: HIGHEST for action port [ 798.298072] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbba38e1-728f-4c48-ba68-4d60d734d33f with Priority: HIGHEST for action port [ 798.298072] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbba38e1-728f-4c48-ba68-4d60d734d33f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.298072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbba38e1-728f-4c48-ba68-4d60d734d33f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.298072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbba38e1-728f-4c48-ba68-4d60d734d33f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.299409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbba38e1-728f-4c48-ba68-4d60d734d33f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.299946] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbba38e1-728f-4c48-ba68-4d60d734d33f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.776874] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 798.776874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.776874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.776874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.776874] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.776874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.776874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.776874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.776874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.779019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.779019] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.780930] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: SUCCESS [ 798.781473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.783019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.783019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.783019] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.783019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.783019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.783019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.783019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.783019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.783019] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.808370] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbba38e1-728f-4c48-ba68-4d60d734d33f [ 798.808370] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.808370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.808370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.808370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.808370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.808370] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbba38e1-728f-4c48-ba68-4d60d734d33f already deleted. [ 798.808370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbba38e1-728f-4c48-ba68-4d60d734d33f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.130474] env[66854]: INFO networking_nsxv3.common.synchronization [None req-0d825f0a-cb4e-4cb0-b280-15a34d77034d None None] Enqueued Resource ID: 4595f0c5-d3f3-4df5-be49-83f39a7765b4 with Priority: HIGHEST for action port [ 799.131446] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4595f0c5-d3f3-4df5-be49-83f39a7765b4 with Priority: HIGHEST for action port [ 799.131864] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4595f0c5-d3f3-4df5-be49-83f39a7765b4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.132053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4595f0c5-d3f3-4df5-be49-83f39a7765b4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.132053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4595f0c5-d3f3-4df5-be49-83f39a7765b4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.132426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4595f0c5-d3f3-4df5-be49-83f39a7765b4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.132555] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4595f0c5-d3f3-4df5-be49-83f39a7765b4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.289052] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.289052] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.289052] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.289052] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.289052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.289826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.289826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.289826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.289826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.289826] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.289826] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.632307] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 in Status: SUCCESS [ 799.632539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.632717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.632958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.634214] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.634214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.634214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.634588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.635824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.635824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.635824] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.636957] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4595f0c5-d3f3-4df5-be49-83f39a7765b4 [ 799.637158] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.637302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.637406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.637561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.637647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.637783] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4595f0c5-d3f3-4df5-be49-83f39a7765b4 already deleted. [ 799.637921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4595f0c5-d3f3-4df5-be49-83f39a7765b4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.793275] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e609d95d-5be9-41f5-b37f-2462907e2f6a: rpc.has_security_group_logging(os_id): False [ 799.797058] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87b57f10-d9c1-422b-ae4f-428ffd202f74: rpc.has_security_group_logging(os_id): False [ 799.815914] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.816225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.816225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.816339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.816433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.816659] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.816759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.816836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.816993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.817114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.817208] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e609d95d-5be9-41f5-b37f-2462907e2f6a is going to be created. [ 799.822518] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.822705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.822808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.823033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.823128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.823343] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.823445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.823510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.823661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.823750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.823959] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.828195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.828876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.828876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.828876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.828876] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.828876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.829120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.829120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.829180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.829266] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 799.912300] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.912460] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.912589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.912764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.912957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.925008] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.925274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.925274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.926019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.926186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.928048] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: IN_PROGRESS for 2s [ 799.947395] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 800.139078] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.646041] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db9d8667-c0a3-4930-8f4b-8672f1d358e9: rpc.has_security_group_logging(os_id): False [ 800.664730] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.670024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.670024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.670024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.670024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.670024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.670024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.670024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.670024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.670024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.670024] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 is going to be created. [ 800.730653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.730910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.730910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.731112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.731307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.746160] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 in Status: IN_PROGRESS for 2s [ 801.254173] env[66854]: INFO networking_nsxv3.common.synchronization [None req-584fefab-bc75-4af8-b6ef-a6c75de77291 tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_rules [ 801.254644] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_rules [ 801.256070] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.256070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.256070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.256070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.256070] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.388693] env[66854]: INFO networking_nsxv3.common.synchronization [None req-20be49f0-ac05-4680-8fa0-05566ebf8a36 tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_rules [ 801.388693] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_rules [ 801.388693] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.388931] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.599420] env[66854]: INFO networking_nsxv3.common.synchronization [None req-0b2429a0-e153-4bd1-8ca3-60075021c19d None None] Enqueued Resource ID: 258a2ff5-de11-4cf3-8f2c-83a3af4f3ec8 with Priority: HIGHEST for action port [ 801.599584] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 258a2ff5-de11-4cf3-8f2c-83a3af4f3ec8 with Priority: HIGHEST for action port [ 801.600161] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-258a2ff5-de11-4cf3-8f2c-83a3af4f3ec8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.600289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-258a2ff5-de11-4cf3-8f2c-83a3af4f3ec8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.600357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-258a2ff5-de11-4cf3-8f2c-83a3af4f3ec8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.602329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-258a2ff5-de11-4cf3-8f2c-83a3af4f3ec8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.602462] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('258a2ff5-de11-4cf3-8f2c-83a3af4f3ec8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.777794] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.777920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.778000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.778263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.778381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.778609] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a already deleted. [ 801.778609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.778750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.779119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.779119] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.942100] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: SUCCESS [ 801.942362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.967027] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 801.967027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.045874] env[66854]: INFO networking_nsxv3.common.synchronization [req-9d5b6d03-2cd2-41c3-a698-38b7514d809a req-ad060699-fef3-4824-b67d-ab818a47e842 tempest-InstanceActionsTestJSON-1805802000 tempest-InstanceActionsTestJSON-1805802000-project-member] Enqueued Resource ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 with Priority: HIGHEST for action security_group_members [ 802.046425] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 with Priority: HIGHEST for action security_group_members [ 802.046735] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f256f-0ee8-49eb-88ef-2d544feb1609 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.046864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.046931] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.047316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.047396] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.047457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.047491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.047745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.047745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.047833] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a11f256f-0ee8-49eb-88ef-2d544feb1609',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.105834] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 258a2ff5-de11-4cf3-8f2c-83a3af4f3ec8 [ 802.106148] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.106402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.106467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.107225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.107479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.107666] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:258a2ff5-de11-4cf3-8f2c-83a3af4f3ec8 already deleted. [ 802.108268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-258a2ff5-de11-4cf3-8f2c-83a3af4f3ec8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.303618] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.303974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.303974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.304067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.304174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.304290] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a already deleted. [ 802.304785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.549917] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.550155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.550279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.550557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.550678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.551080] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.551663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.551663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.551663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.551815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.551966] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 is going to be updated. [ 802.585232] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.585232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.585562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.585562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.585666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.599042] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 in Status: IN_PROGRESS for 2s [ 802.762812] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 in Status: SUCCESS [ 802.762812] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.192051] env[66854]: INFO networking_nsxv3.common.synchronization [req-14273860-2b79-42ce-85f6-142a4f1d63a5 req-583c141b-443a-4b54-a057-efe73bb2a09d tempest-ServersWithSpecificFlavorTestJSON-1363282919 tempest-ServersWithSpecificFlavorTestJSON-1363282919-project-member] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 803.192622] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 803.194153] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.194153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.194579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.195567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.195855] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.196372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.196372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.196372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.196506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.196605] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.603284] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-443 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.603623] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.603765] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.604272] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.604586] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.605094] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.605241] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.605785] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.606048] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.606290] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 803.606395] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.606503] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.606607] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.606739] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 803.606852] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.607014] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.629927] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.630143] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 803.630373] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.630646] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-443" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.631131] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-caa1f378-8ee3-422d-b23d-b1e33e5df66b taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.631398] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-caa1f378-8ee3-422d-b23d-b1e33e5df66b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.631597] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-caa1f378-8ee3-422d-b23d-b1e33e5df66b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.632060] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-caa1f378-8ee3-422d-b23d-b1e33e5df66b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.632290] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('caa1f378-8ee3-422d-b23d-b1e33e5df66b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.702372] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.702571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.702571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.702800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.702896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.703205] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.703388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.703388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.703575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.703615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.703683] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e is going to be updated. [ 803.730019] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.730214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.730254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.730445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.730588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.739331] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: IN_PROGRESS for 2s [ 804.135194] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.135429] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.135555] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.135847] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.135998] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.136172] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port caa1f378-8ee3-422d-b23d-b1e33e5df66b not found, creating... [ 804.136446] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.136644] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.136759] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.136990] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.137253] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.137685] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.137931] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.138141] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.138468] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.138704] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.138968] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: caa1f378-8ee3-422d-b23d-b1e33e5df66b is going to be created. [ 804.161124] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.161414] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.161550] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.162061] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.162244] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.162460] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-caa1f378-8ee3-422d-b23d-b1e33e5df66b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.618803] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 in Status: SUCCESS [ 804.619152] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 deletion is rescheduled due to dependency. [ 804.619204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.875710] env[66854]: INFO networking_nsxv3.common.synchronization [req-14273860-2b79-42ce-85f6-142a4f1d63a5 req-69213e3e-6ba6-4b16-9d66-a9d60d604338 service nova] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_rules [ 804.875896] env[66854]: INFO networking_nsxv3.common.synchronization [req-14273860-2b79-42ce-85f6-142a4f1d63a5 req-69213e3e-6ba6-4b16-9d66-a9d60d604338 service nova] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 804.876218] env[66854]: INFO networking_nsxv3.common.synchronization [req-14273860-2b79-42ce-85f6-142a4f1d63a5 req-69213e3e-6ba6-4b16-9d66-a9d60d604338 service nova] Enqueued Resource ID: caa1f378-8ee3-422d-b23d-b1e33e5df66b with Priority: HIGHEST for action port [ 804.876782] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_rules [ 804.876944] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 804.877186] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caa1f378-8ee3-422d-b23d-b1e33e5df66b with Priority: HIGHEST for action port [ 804.877507] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.877631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.877700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.877922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.878013] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.879069] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.879172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.879366] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-caa1f378-8ee3-422d-b23d-b1e33e5df66b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.879487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-caa1f378-8ee3-422d-b23d-b1e33e5df66b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.879565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-caa1f378-8ee3-422d-b23d-b1e33e5df66b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.879755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-caa1f378-8ee3-422d-b23d-b1e33e5df66b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.879839] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('caa1f378-8ee3-422d-b23d-b1e33e5df66b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.910531] env[66854]: INFO networking_nsxv3.common.synchronization [None req-393bad47-eda7-4ae7-b358-ed76ba952edc None None] Enqueued Resource ID: 0b6ad278-31ad-4411-97be-60812f12d11d with Priority: HIGHEST for action port [ 804.912785] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6ad278-31ad-4411-97be-60812f12d11d with Priority: HIGHEST for action port [ 804.914498] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b6ad278-31ad-4411-97be-60812f12d11d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.914634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b6ad278-31ad-4411-97be-60812f12d11d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.914707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b6ad278-31ad-4411-97be-60812f12d11d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.915892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b6ad278-31ad-4411-97be-60812f12d11d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.916025] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b6ad278-31ad-4411-97be-60812f12d11d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.381595] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.381810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.382067] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port caa1f378-8ee3-422d-b23d-b1e33e5df66b with status ACTIVE [ 805.382295] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.382455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.382557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.382817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.382974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.383265] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.383455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.383558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.383777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.383908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.384162] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.384326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.384426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.384640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.384765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.384897] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: caa1f378-8ee3-422d-b23d-b1e33e5df66b is going to be updated. [ 805.414260] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.414410] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.414480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.414683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.414819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.414990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-caa1f378-8ee3-422d-b23d-b1e33e5df66b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.418519] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b6ad278-31ad-4411-97be-60812f12d11d [ 805.418734] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.418857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.419215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.419445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.419572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.419667] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b6ad278-31ad-4411-97be-60812f12d11d already deleted. [ 805.419963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b6ad278-31ad-4411-97be-60812f12d11d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.753207] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: SUCCESS [ 805.753207] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e deletion is rescheduled due to dependency. [ 805.753207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.753207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.753207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.753207] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.753207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.753207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.753207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.753207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.753207] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.254120] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.761522] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.264707] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.264865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.264939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.265178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.265286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.265390] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e is going to be updated. [ 807.315192] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.315192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.315192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.315626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.315626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.320819] env[66854]: INFO networking_nsxv3.common.synchronization [None req-f3117467-517b-43ee-ba3a-97dfb4f4768e None None] Enqueued Resource ID: 17aa8329-b916-435a-a831-95fc26e32b1a with Priority: HIGHEST for action port [ 807.321157] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17aa8329-b916-435a-a831-95fc26e32b1a with Priority: HIGHEST for action port [ 807.321507] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-17aa8329-b916-435a-a831-95fc26e32b1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.321620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17aa8329-b916-435a-a831-95fc26e32b1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.322249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17aa8329-b916-435a-a831-95fc26e32b1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.322249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17aa8329-b916-435a-a831-95fc26e32b1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.322249] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17aa8329-b916-435a-a831-95fc26e32b1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.328578] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: IN_PROGRESS for 2s [ 807.826107] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17aa8329-b916-435a-a831-95fc26e32b1a [ 807.826107] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.826107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.826107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.826817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.826817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.826817] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17aa8329-b916-435a-a831-95fc26e32b1a already deleted. [ 807.826817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17aa8329-b916-435a-a831-95fc26e32b1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.379216] env[66854]: INFO networking_nsxv3.common.synchronization [None req-db9a0657-897d-4920-93c8-7c25cd02fcc7 None None] Enqueued Resource ID: 2116dcdd-022f-45dc-bcc6-8985402a2091 with Priority: HIGHEST for action port [ 808.380213] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2116dcdd-022f-45dc-bcc6-8985402a2091 with Priority: HIGHEST for action port [ 808.380762] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-2116dcdd-022f-45dc-bcc6-8985402a2091 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.380983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2116dcdd-022f-45dc-bcc6-8985402a2091" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.381302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2116dcdd-022f-45dc-bcc6-8985402a2091" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.381533] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2116dcdd-022f-45dc-bcc6-8985402a2091" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.381682] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2116dcdd-022f-45dc-bcc6-8985402a2091',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.392512] env[66854]: INFO networking_nsxv3.common.synchronization [None req-3e032f31-af48-4822-b7d3-93af45ec2112 None None] Enqueued Resource ID: ec40ee8f-f2c6-4ddd-8bf5-95d603d5b9d2 with Priority: HIGHEST for action port [ 808.392512] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec40ee8f-f2c6-4ddd-8bf5-95d603d5b9d2 with Priority: HIGHEST for action port [ 808.392512] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec40ee8f-f2c6-4ddd-8bf5-95d603d5b9d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.392512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec40ee8f-f2c6-4ddd-8bf5-95d603d5b9d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.392897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec40ee8f-f2c6-4ddd-8bf5-95d603d5b9d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.392897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec40ee8f-f2c6-4ddd-8bf5-95d603d5b9d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.393093] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec40ee8f-f2c6-4ddd-8bf5-95d603d5b9d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.886264] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2116dcdd-022f-45dc-bcc6-8985402a2091 [ 808.886264] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.886264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.887464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.887464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.887464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.887464] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2116dcdd-022f-45dc-bcc6-8985402a2091 already deleted. [ 808.887464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2116dcdd-022f-45dc-bcc6-8985402a2091" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.897489] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec40ee8f-f2c6-4ddd-8bf5-95d603d5b9d2 [ 808.897489] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.897489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.897489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.897489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.897489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.897489] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec40ee8f-f2c6-4ddd-8bf5-95d603d5b9d2 already deleted. [ 808.897489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec40ee8f-f2c6-4ddd-8bf5-95d603d5b9d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.342917] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: SUCCESS [ 809.342917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.342917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.342917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.343170] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.343260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.343303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.343445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.343534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.343633] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.343748] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.381595] env[66854]: INFO networking_nsxv3.common.synchronization [req-07dba287-de49-4917-a8a7-d702cf9f3546 req-08b6784b-6609-4d5f-9c46-9059c29921c1 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 809.381780] env[66854]: INFO networking_nsxv3.common.synchronization [req-07dba287-de49-4917-a8a7-d702cf9f3546 req-08b6784b-6609-4d5f-9c46-9059c29921c1 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea with Priority: HIGHEST for action security_group_members [ 809.381909] env[66854]: INFO networking_nsxv3.common.synchronization [req-07dba287-de49-4917-a8a7-d702cf9f3546 req-08b6784b-6609-4d5f-9c46-9059c29921c1 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_members [ 809.382676] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 809.382807] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea with Priority: HIGHEST for action security_group_members [ 809.382903] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_members [ 809.383584] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.383584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.383584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.383734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.383839] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.383890] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.383959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.384108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.384186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.384288] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.385162] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.385275] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.385328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.385540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.388892] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.388892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.388892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.388892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.388892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.389326] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.391165] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e609d95d-5be9-41f5-b37f-2462907e2f6a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.391342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.391415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.391592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.391754] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.391853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.391918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.392075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.392156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.392255] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.447577] env[66854]: INFO networking_nsxv3.common.synchronization [req-07dba287-de49-4917-a8a7-d702cf9f3546 req-08b6784b-6609-4d5f-9c46-9059c29921c1 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea with Priority: HIGHEST for action security_group_rules [ 809.447790] env[66854]: INFO networking_nsxv3.common.synchronization [req-07dba287-de49-4917-a8a7-d702cf9f3546 req-08b6784b-6609-4d5f-9c46-9059c29921c1 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea with Priority: HIGHEST for action security_group_members [ 809.447966] env[66854]: INFO networking_nsxv3.common.synchronization [req-07dba287-de49-4917-a8a7-d702cf9f3546 req-08b6784b-6609-4d5f-9c46-9059c29921c1 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 809.448141] env[66854]: INFO networking_nsxv3.common.synchronization [req-07dba287-de49-4917-a8a7-d702cf9f3546 req-08b6784b-6609-4d5f-9c46-9059c29921c1 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 809.448296] env[66854]: INFO networking_nsxv3.common.synchronization [req-07dba287-de49-4917-a8a7-d702cf9f3546 req-08b6784b-6609-4d5f-9c46-9059c29921c1 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_rules [ 809.448503] env[66854]: INFO networking_nsxv3.common.synchronization [req-07dba287-de49-4917-a8a7-d702cf9f3546 req-08b6784b-6609-4d5f-9c46-9059c29921c1 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_members [ 809.448652] env[66854]: INFO networking_nsxv3.common.synchronization [req-07dba287-de49-4917-a8a7-d702cf9f3546 req-08b6784b-6609-4d5f-9c46-9059c29921c1 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 9bef4d73-953b-40d9-887e-593d0ec6e5b3 with Priority: HIGHEST for action port [ 809.449215] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea with Priority: HIGHEST for action security_group_rules [ 809.449409] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_rules [ 809.449538] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_members [ 809.449657] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bef4d73-953b-40d9-887e-593d0ec6e5b3 with Priority: HIGHEST for action port [ 809.449771] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_rules [ 809.449907] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea with Priority: HIGHEST for action security_group_members [ 809.449986] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 809.450309] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.450468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.450546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.450823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.450933] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.452313] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.452473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.452621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.452762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.452861] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.454676] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e609d95d-5be9-41f5-b37f-2462907e2f6a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.454772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.455409] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bef4d73-953b-40d9-887e-593d0ec6e5b3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.455409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.455409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.455409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.455409] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bef4d73-953b-40d9-887e-593d0ec6e5b3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.456261] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e609d95d-5be9-41f5-b37f-2462907e2f6a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.456261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.456401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.456609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.456609] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.459248] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.459248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.459248] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.459425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.637142] env[66854]: INFO networking_nsxv3.common.synchronization [req-b5680c25-8a14-42c6-888f-0d8969b7ab70 req-be20f6b3-f208-4a5f-8fad-abf660e3eb83 tempest-InstanceActionsNegativeTestJSON-1267599867 tempest-InstanceActionsNegativeTestJSON-1267599867-project-member] Enqueued Resource ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e with Priority: HIGHEST for action security_group_members [ 809.637664] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e with Priority: HIGHEST for action security_group_members [ 809.637960] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-9780d851-7ce4-4e40-ae84-ac55f3124f1e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.638084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.638149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.638411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.638573] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.638665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.638725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.638871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.638947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.640395] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9780d851-7ce4-4e40-ae84-ac55f3124f1e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.845808] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.895474] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.896538] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.897765] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.961573] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.961849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.962765] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bef4d73-953b-40d9-887e-593d0ec6e5b3 with status ACTIVE [ 809.962765] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.962765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.962765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.963026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.963515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.963515] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.963515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.963515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.963911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.964094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.964349] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.965035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.965035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.965035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.965035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.965035] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bef4d73-953b-40d9-887e-593d0ec6e5b3 is going to be updated. [ 809.966470] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.966708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.973850] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e609d95d-5be9-41f5-b37f-2462907e2f6a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.974043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.000327] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.000327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.000327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.000327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.000327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.000327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bef4d73-953b-40d9-887e-593d0ec6e5b3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.090745] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-970 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.091034] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-970" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.091141] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-970" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.091560] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-970" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.091850] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.092266] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.092453] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.092714] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.092916] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.093163] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.093266] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.093384] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.093528] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.093661] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.093707] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.093811] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.118908] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.118908] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 810.118908] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.118908] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-970" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.118908] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-5b84d3ac-6d2f-4cce-b475-8a0e81939beb taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.118908] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-5b84d3ac-6d2f-4cce-b475-8a0e81939beb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.118908] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-5b84d3ac-6d2f-4cce-b475-8a0e81939beb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.118908] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-5b84d3ac-6d2f-4cce-b475-8a0e81939beb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.119280] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b84d3ac-6d2f-4cce-b475-8a0e81939beb',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.144095] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.144284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.144349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.144751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.144854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.145083] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.145196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.145256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.145419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.145494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.145581] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e already deleted. [ 810.145665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.348183] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0fd45c4-bc5d-47a2-a08d-dfba578f269e: rpc.has_security_group_logging(os_id): False [ 810.369213] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.369416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.369416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.369611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.369705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.369973] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.370090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.370155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.370316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.370398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.370484] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e is going to be updated. [ 810.399397] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.403020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.403020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.447229] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.447229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.447229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.447447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.447627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.464864] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: IN_PROGRESS for 2s [ 810.622077] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.622438] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.622562] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.623000] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.623177] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.623335] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 5b84d3ac-6d2f-4cce-b475-8a0e81939beb not found, creating... [ 810.623700] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.623870] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.624030] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.624270] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.624431] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.624750] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.624906] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.625032] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.625242] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.625373] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.625513] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 5b84d3ac-6d2f-4cce-b475-8a0e81939beb is going to be created. [ 810.648494] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.648826] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.648826] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.649114] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.649503] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.650677] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-5b84d3ac-6d2f-4cce-b475-8a0e81939beb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.903761] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.904083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.904083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.904483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.904483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.904589] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea is going to be created. [ 810.906652] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.907301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.907301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.907576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.907711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.907915] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 810.909646] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.910973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.910973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.910973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.910973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.910973] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e609d95d-5be9-41f5-b37f-2462907e2f6a is going to be updated. [ 810.952266] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.952808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.952890] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.953131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.953531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.956188] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.956314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.956578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.956849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.957083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.959291] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.959566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.959685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.959962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.960203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.973944] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 810.975673] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: IN_PROGRESS for 2s [ 810.976248] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea in Status: UNINITIALIZED for 2s [ 811.403758] env[66854]: INFO networking_nsxv3.common.synchronization [None req-21814f34-9ade-499d-bb65-38e076f125e6 None None] Enqueued Resource ID: cdfe624d-a921-43ca-94e3-79b851463f0c with Priority: HIGHEST for action port [ 811.404560] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdfe624d-a921-43ca-94e3-79b851463f0c with Priority: HIGHEST for action port [ 811.404560] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdfe624d-a921-43ca-94e3-79b851463f0c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.404560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdfe624d-a921-43ca-94e3-79b851463f0c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.404840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdfe624d-a921-43ca-94e3-79b851463f0c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.404885] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdfe624d-a921-43ca-94e3-79b851463f0c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.404957] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdfe624d-a921-43ca-94e3-79b851463f0c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.419756] env[66854]: INFO networking_nsxv3.common.synchronization [req-b5680c25-8a14-42c6-888f-0d8969b7ab70 req-95d5aedf-3716-4cbe-baea-326142de9120 service nova] Enqueued Resource ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e with Priority: HIGHEST for action security_group_rules [ 811.419915] env[66854]: INFO networking_nsxv3.common.synchronization [req-b5680c25-8a14-42c6-888f-0d8969b7ab70 req-95d5aedf-3716-4cbe-baea-326142de9120 service nova] Enqueued Resource ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e with Priority: HIGHEST for action security_group_members [ 811.420056] env[66854]: INFO networking_nsxv3.common.synchronization [req-b5680c25-8a14-42c6-888f-0d8969b7ab70 req-95d5aedf-3716-4cbe-baea-326142de9120 service nova] Enqueued Resource ID: 5b84d3ac-6d2f-4cce-b475-8a0e81939beb with Priority: HIGHEST for action port [ 811.420539] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e with Priority: HIGHEST for action security_group_rules [ 811.420665] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e with Priority: HIGHEST for action security_group_members [ 811.420754] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b84d3ac-6d2f-4cce-b475-8a0e81939beb with Priority: HIGHEST for action port [ 811.424117] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9780d851-7ce4-4e40-ae84-ac55f3124f1e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.424117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.424117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.424117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.424117] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9780d851-7ce4-4e40-ae84-ac55f3124f1e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.425250] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-9780d851-7ce4-4e40-ae84-ac55f3124f1e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.425384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.425422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.425671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.426021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.426021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.426021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.426211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.426211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.428164] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9780d851-7ce4-4e40-ae84-ac55f3124f1e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.428164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b84d3ac-6d2f-4cce-b475-8a0e81939beb taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.428164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b84d3ac-6d2f-4cce-b475-8a0e81939beb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.428164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b84d3ac-6d2f-4cce-b475-8a0e81939beb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.428742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b84d3ac-6d2f-4cce-b475-8a0e81939beb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.428742] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b84d3ac-6d2f-4cce-b475-8a0e81939beb',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.908873] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdfe624d-a921-43ca-94e3-79b851463f0c [ 811.909380] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.909380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.909536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.909698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.909810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.909957] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdfe624d-a921-43ca-94e3-79b851463f0c already deleted. [ 811.909957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdfe624d-a921-43ca-94e3-79b851463f0c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.929867] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9780d851-7ce4-4e40-ae84-ac55f3124f1e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.932071] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-9780d851-7ce4-4e40-ae84-ac55f3124f1e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.932071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.932071] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b84d3ac-6d2f-4cce-b475-8a0e81939beb with status ACTIVE [ 811.932071] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.932316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.932316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.932483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.932549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.932758] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.932877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.932943] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.933401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.933683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.934217] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.934337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.934407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.934786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.934786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.934994] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b84d3ac-6d2f-4cce-b475-8a0e81939beb is going to be updated. [ 811.968637] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.968786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.969126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.969126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.969356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.970026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b84d3ac-6d2f-4cce-b475-8a0e81939beb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.433026] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9780d851-7ce4-4e40-ae84-ac55f3124f1e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.452080] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.453770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.453770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.453770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.453770] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.479591] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: SUCCESS [ 812.479869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.937348] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.937757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.937757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.937900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.937982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.938154] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e is going to be created. [ 812.957273] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.980668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.980668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.980668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.980815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.981016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.985230] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 812.985438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.985598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.985818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.986036] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.986132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.986208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.986369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.986450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.986548] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.993353] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: SUCCESS [ 812.993353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.993353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.993353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.993353] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.993353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.993353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.993353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.993353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.993353] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.995287] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e in Status: UNINITIALIZED for 2s [ 812.999279] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea in Status: SUCCESS [ 813.000179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.000179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.000179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.000179] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.000416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.000416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.000580] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.000668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.000770] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.320591] env[66854]: INFO networking_nsxv3.common.synchronization [None req-20e568a5-71c8-4e20-9b4c-fd4bedaffd19 None None] Enqueued Resource ID: fd6880b5-4291-4eea-bfcd-007d063807c2 with Priority: HIGHEST for action port [ 813.321549] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6880b5-4291-4eea-bfcd-007d063807c2 with Priority: HIGHEST for action port [ 813.321925] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd6880b5-4291-4eea-bfcd-007d063807c2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.322142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd6880b5-4291-4eea-bfcd-007d063807c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.322280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd6880b5-4291-4eea-bfcd-007d063807c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.322659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd6880b5-4291-4eea-bfcd-007d063807c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.322780] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd6880b5-4291-4eea-bfcd-007d063807c2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.459724] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.490559] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.499422] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.503030] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.826654] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd6880b5-4291-4eea-bfcd-007d063807c2 [ 813.826932] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.827094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.827168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.827461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.827567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.827670] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd6880b5-4291-4eea-bfcd-007d063807c2 already deleted. [ 813.827763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd6880b5-4291-4eea-bfcd-007d063807c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.941075] env[66854]: INFO networking_nsxv3.common.synchronization [req-44bc067d-a568-4ea5-981e-bb17ef51c9c8 req-30e1715f-8586-4d87-8cf2-d7757ad5739c tempest-TenantUsagesTestJSON-1057132391 tempest-TenantUsagesTestJSON-1057132391-project-member] Enqueued Resource ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 with Priority: HIGHEST for action security_group_members [ 813.941919] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 with Priority: HIGHEST for action security_group_members [ 813.942852] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8bfd71e-0706-4e38-94f5-8c8814c273e6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.942980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.943080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.943286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.943499] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.943636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.943707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.943950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.944065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.944165] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8bfd71e-0706-4e38-94f5-8c8814c273e6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.962898] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 813.962992] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 813.994657] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.002941] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.006807] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.447506] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.447652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.447727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.447997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.448118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.448440] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.448440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.448594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.448681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.448746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.448837] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 is going to be updated. [ 814.487656] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.487901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.487964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.488200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.488384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.497578] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.497811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.497811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.497992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.498100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.498201] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 814.500021] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 in Status: IN_PROGRESS for 2s [ 814.506930] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.507103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.507177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.507361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.507447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.507544] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e609d95d-5be9-41f5-b37f-2462907e2f6a is going to be updated. [ 814.510366] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.510509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.510591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.510778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.510867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.510985] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea is going to be updated. [ 814.526852] env[66854]: INFO networking_nsxv3.common.synchronization [req-766472e7-e551-40df-bdb8-7b4b02438914 req-a304b17a-0acb-4b12-9b9d-1903b4f046e7 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea with Priority: HIGHEST for action security_group_members [ 814.526987] env[66854]: INFO networking_nsxv3.common.synchronization [req-766472e7-e551-40df-bdb8-7b4b02438914 req-a304b17a-0acb-4b12-9b9d-1903b4f046e7 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 814.527149] env[66854]: INFO networking_nsxv3.common.synchronization [req-766472e7-e551-40df-bdb8-7b4b02438914 req-a304b17a-0acb-4b12-9b9d-1903b4f046e7 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_members [ 814.528501] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea with Priority: HIGHEST for action security_group_members [ 814.528501] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 814.528501] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGHEST for action security_group_members [ 814.528501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.528501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.528684] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.528770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.528994] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e609d95d-5be9-41f5-b37f-2462907e2f6a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.529146] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.530157] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.530293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.530675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.530917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.531088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.546282] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 814.551684] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.551684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.551684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.551684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.551684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.555464] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.555610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.555679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.555878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.556021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.564163] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea in Status: IN_PROGRESS for 2s [ 814.567247] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: IN_PROGRESS for 2s [ 814.962215] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.962547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.962547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.962645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.976085] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 814.977357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.978052] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 815.005756] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.005919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.006085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.006302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.013379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.013901] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 815.013985] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 815.014086] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 815.015819] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e in Status: SUCCESS [ 815.016068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.016652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.016862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.017069] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.017187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.017252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.017409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.017487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.017571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.017667] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9780d851-7ce4-4e40-ae84-ac55f3124f1e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.058590] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.058896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.060065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.060065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.062016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.062374] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 815.153458] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.153745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.153745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.156451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.156451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.156451] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 815.340093] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.340353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.340353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.340616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.340862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.341154] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:31. [ 815.341293] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'57f39420-06ae-4013-a107-2dab8327c1d0', '26ccc5a4-8c8a-445b-b37a-462c691c3639', '2102370c-50ee-4712-bad2-1dc6ac49ebb5', '00e0f7e9-6f3b-4bea-945c-76f1da468a99', '6b68d89c-9278-4047-a0c4-e471d31223ed', 'b0fd45c4-bc5d-47a2-a08d-dfba578f269e', 'b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3', '87b57f10-d9c1-422b-ae4f-428ffd202f74', '522304fc-ecb3-47d1-844c-54013760964c', '28446920-c13b-4dfc-87e9-c9f98af2604c', 'cc128a33-d808-470d-8d77-03637a1be1ce', 'a1871982-9cf3-4b58-bd63-59badb5546d2', '4b47b969-b701-468c-8b2e-9e8473ecb61d', '3e79fde6-a444-40c2-9d78-9932f7d7c5ff', '882c622e-5e75-4cbc-a5f9-518be75e1bd0', '92583910-38be-424b-ae0b-e27f87da131b', 'db9d8667-c0a3-4930-8f4b-8672f1d358e9', 'a11f256f-0ee8-49eb-88ef-2d544feb1609', 'aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd', '202dfdd2-4f71-40b3-a725-b25d1a9dfafa', '404f4fa4-39e5-44f2-b930-0c5f5853142c', '4147e97c-db2e-4b4d-a03e-ee42eaaab8e0', 'e609d95d-5be9-41f5-b37f-2462907e2f6a', '7025fd1c-e490-40e6-9db4-8ead9e399bb5', '480a784d-e1e2-4919-8cb1-9c77138c1be4', '82708b01-13e8-453a-8492-93929a99b850', 'f8bfd71e-0706-4e38-94f5-8c8814c273e6', '5b4083ca-5955-4d5e-bfa3-13977c48a75e', '004af225-cfe6-418e-bf9b-b21fc4fcd911', 'a491a51f-1883-4e2c-a822-89d817e590ca', '141d1a4a-af29-49fe-8321-94ad97de005a'} {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 815.341436] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 815.398076] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.398076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.398076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.398403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.398403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.398546] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 815.398663] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 815.399049] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 815.508546] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.508830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.508830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.508986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.513040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.513040] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 815.513040] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 815.513040] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 815.513040] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 815.513040] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/31 resources of Type:Security Group Rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57f39420-06ae-4013-a107-2dab8327c1d0 with Priority: HIGH for action security_group_rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGH for action security_group_rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGH for action security_group_rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGH for action security_group_rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGH for action security_group_rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGH for action security_group_rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGH for action security_group_rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGH for action security_group_rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGH for action security_group_rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28446920-c13b-4dfc-87e9-c9f98af2604c with Priority: HIGH for action security_group_rules [ 815.513040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGH for action security_group_rules [ 815.514051] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGH for action security_group_rules [ 815.514235] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d with Priority: HIGH for action security_group_rules [ 815.514404] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff with Priority: HIGH for action security_group_rules [ 815.514574] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGH for action security_group_rules [ 815.514869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92583910-38be-424b-ae0b-e27f87da131b with Priority: HIGH for action security_group_rules [ 815.515073] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGH for action security_group_rules [ 815.515351] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 with Priority: HIGH for action security_group_rules [ 815.515753] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGH for action security_group_rules [ 815.515950] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGH for action security_group_rules [ 815.516188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.520137] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-9780d851-7ce4-4e40-ae84-ac55f3124f1e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.520443] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.520443] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.520878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.521224] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.521571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.521740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.522083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.523063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.523208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.523395] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-9780d851-7ce4-4e40-ae84-ac55f3124f1e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.523529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.523586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.524229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.524229] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.524229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.524229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.526285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.526285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.526285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.526285] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9780d851-7ce4-4e40-ae84-ac55f3124f1e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.849882] env[66854]: INFO networking_nsxv3.common.synchronization [req-ced821aa-fa47-436c-b072-d7fbc6c36080 req-a66806d2-d2e5-4fc8-b5a6-6eb3f6c115ed tempest-ServerActionsTestOtherB-456566424 tempest-ServerActionsTestOtherB-456566424-project-member] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 815.850299] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 815.850448] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f39420-06ae-4013-a107-2dab8327c1d0 with Priority: HIGH for action security_group_rules [ 815.850589] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGH for action security_group_rules [ 815.850706] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGH for action security_group_rules [ 815.850806] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 with Priority: HIGH for action security_group_rules [ 815.850904] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa with Priority: HIGH for action security_group_rules [ 815.851160] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGH for action security_group_rules [ 815.851160] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 with Priority: HIGH for action security_group_rules [ 815.851271] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGH for action security_group_rules [ 815.851271] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff with Priority: HIGH for action security_group_rules [ 815.851347] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92583910-38be-424b-ae0b-e27f87da131b with Priority: HIGH for action security_group_rules [ 815.851438] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d with Priority: HIGH for action security_group_rules [ 815.851526] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1871982-9cf3-4b58-bd63-59badb5546d2 with Priority: HIGH for action security_group_rules [ 815.851615] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGH for action security_group_rules [ 815.851728] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28446920-c13b-4dfc-87e9-c9f98af2604c with Priority: HIGH for action security_group_rules [ 815.851836] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGH for action security_group_rules [ 815.851925] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGH for action security_group_rules [ 815.852023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGH for action security_group_rules [ 815.852109] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b68d89c-9278-4047-a0c4-e471d31223ed with Priority: HIGH for action security_group_rules [ 815.852284] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGH for action security_group_rules [ 815.852284] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGH for action security_group_rules [ 815.852548] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.852679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.852782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.853681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.853884] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.853999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.854075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.854252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.854617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.854755] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.855776] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57f39420-06ae-4013-a107-2dab8327c1d0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.855891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.855891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.856395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.856395] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57f39420-06ae-4013-a107-2dab8327c1d0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.857100] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.857211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.857278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.857433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.858031] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.858517] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.858517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.858517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.858517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.858813] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.859206] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.859905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.859905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.859905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.859905] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882c622e-5e75-4cbc-a5f9-518be75e1bd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.860605] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.860715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.860774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.860948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.861036] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('202dfdd2-4f71-40b3-a725-b25d1a9dfafa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.863706] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.863869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.863869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.864025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.864091] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.865285] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a11f256f-0ee8-49eb-88ef-2d544feb1609 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.865285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.865285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.865384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.865384] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a11f256f-0ee8-49eb-88ef-2d544feb1609',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.866483] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.866620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.867331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.867508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.867587] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.868660] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e79fde6-a444-40c2-9d78-9932f7d7c5ff taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.868787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.868982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.869152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.869227] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e79fde6-a444-40c2-9d78-9932f7d7c5ff',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.869656] env[66854]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 815.870418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92583910-38be-424b-ae0b-e27f87da131b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.870518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.870583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.870844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.870922] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92583910-38be-424b-ae0b-e27f87da131b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.871834] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b47b969-b701-468c-8b2e-9e8473ecb61d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.871952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.872028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.872183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.872256] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b47b969-b701-468c-8b2e-9e8473ecb61d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.873994] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1871982-9cf3-4b58-bd63-59badb5546d2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.874180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.874255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.876193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.876295] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1871982-9cf3-4b58-bd63-59badb5546d2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.877163] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.877289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.877345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.877505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.877578] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.878448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28446920-c13b-4dfc-87e9-c9f98af2604c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.878544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.878613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.878763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.878839] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28446920-c13b-4dfc-87e9-c9f98af2604c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.880240] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.880361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.881311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.881489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.881566] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.882540] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.882662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.883765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.883897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.884048] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.884836] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.884937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.885130] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b68d89c-9278-4047-a0c4-e471d31223ed taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.885230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.885385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.885472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.885628] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b68d89c-9278-4047-a0c4-e471d31223ed',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.886800] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.886902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.886969] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.887135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.887207] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.888050] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.888157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.888225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.888392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.888435] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.888639] env[66854]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 816.055680] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9780d851-7ce4-4e40-ae84-ac55f3124f1e: rpc.has_security_group_logging(os_id): False [ 816.089950] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.091159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.091159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.091159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.091159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.091433] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.091598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.092456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.092456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.092456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.092456] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.093227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.093227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.093227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.093227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.093227] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.093445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.093445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.094856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.094856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.094856] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e is going to be created. [ 816.166575] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.167028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.167028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.167638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.167730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.186091] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e in Status: IN_PROGRESS for 2s [ 816.390891] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.395024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.395024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.395024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.395024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.395024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.395024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.395024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.395024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.395024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.395024] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.395024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.395024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.395024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.395598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.395598] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.395598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.395598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.395760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.395910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.396020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.396176] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.397856] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.397996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.398104] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.398314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.398425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.398685] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.398814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.398904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.399132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.399255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.399389] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 already deleted. [ 816.399502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.422112] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.422332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.422417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.422714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.431405] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-323 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.431605] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.431761] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.432140] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.432415] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.432577] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.432696] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.432965] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.433134] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.433354] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.433466] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.433575] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.433674] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.433816] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.433883] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.434071] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.457274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.457410] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57f39420-06ae-4013-a107-2dab8327c1d0 is going to be deleted. [ 816.459226] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.459454] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 816.459598] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.459779] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.460132] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-6249a178-0f24-40bf-80f5-dc2d14733531 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.460306] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-6249a178-0f24-40bf-80f5-dc2d14733531" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.460425] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-6249a178-0f24-40bf-80f5-dc2d14733531" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.460724] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-6249a178-0f24-40bf-80f5-dc2d14733531" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.460857] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6249a178-0f24-40bf-80f5-dc2d14733531',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.509220] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 in Status: SUCCESS [ 816.509385] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 deletion is rescheduled due to dependency. [ 816.509503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.520748] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.520851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.520888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.521437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.521437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.521437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57f39420-06ae-4013-a107-2dab8327c1d0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.565224] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 816.566640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.568744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.568822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.569066] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.569193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.569259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.569419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.569503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.569591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.569692] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.574146] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.574270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.574340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.574551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.574712] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.574844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.574892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.575041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.575148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.575237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.575334] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.578806] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e0f7e9-6f3b-4bea-945c-76f1da468a99 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.578989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.579350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.579350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.579571] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.579625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.579658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.579832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.579916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.580023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.580125] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.582407] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-db9d8667-c0a3-4930-8f4b-8672f1d358e9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.582515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.582583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.582764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.582930] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.583128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.583185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.583296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.583378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.583463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.583549] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.584611] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.584721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.584760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.584894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.585054] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.585152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.585445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.585445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.585445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.585549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.585580] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.588931] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.589058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.589226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.589314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.589484] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.589584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.589664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.589842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.589942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.590016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.590104] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.590897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.591071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.591253] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.591342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.591439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.591603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.591603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.591694] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.595438] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.595624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.595686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.596444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.596444] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.596444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.596444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.596444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.596444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.596798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.596798] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.608700] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.608857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.612567] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.635664] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea in Status: SUCCESS [ 816.635834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.636257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.636509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.636684] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.636803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.636867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.637049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.637128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.637213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.637325] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.639233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.639233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.639233] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.639233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.639233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.639233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.639233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.639233] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.647225] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.647365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.647460] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.647687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.674816] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: SUCCESS [ 816.675159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.676539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.676539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.676539] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.676539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.676539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.676843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.676843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.676843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.676843] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.681461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.681694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.682029] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.683121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.683121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.683121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.683121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.683121] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.685629] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.685917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.687951] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.687951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.698598] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.698971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.700619] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.701323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.704237] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.704237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.705346] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.707139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.707139] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.707139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.709319] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.709477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.710518] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 816.711071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.711219] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882c622e-5e75-4cbc-a5f9-518be75e1bd0 is going to be deleted. [ 816.712255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.712565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.738990] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.739250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.799891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.799891] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be deleted. [ 816.800232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.801967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.848340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.848633] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 202dfdd2-4f71-40b3-a725-b25d1a9dfafa is going to be deleted. [ 816.849629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.849966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.865076] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.865337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.890844] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.891109] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.903156] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.904754] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.904942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.904998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.905198] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.905416] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.905560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.905633] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.906328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.906443] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.906541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.906715] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.906814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.906871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.907034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.907177] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.907270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.907334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.907464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.907539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.907625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.907727] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.909907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.910092] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92583910-38be-424b-ae0b-e27f87da131b is going to be deleted. [ 816.911860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.912121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.950918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.951151] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e79fde6-a444-40c2-9d78-9932f7d7c5ff is going to be deleted. [ 816.952259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.952504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.955580] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.955691] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.964470] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.964574] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.964706] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.965053] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.965305] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.965376] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 6249a178-0f24-40bf-80f5-dc2d14733531 not found, creating... [ 816.965638] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.965865] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.966023] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.966342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.966412] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.966723] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.966880] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.967043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.967413] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.967459] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.967599] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 6249a178-0f24-40bf-80f5-dc2d14733531 is going to be created. [ 817.020074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.020202] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b47b969-b701-468c-8b2e-9e8473ecb61d is going to be deleted. [ 817.021209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.021424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.034338] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.034566] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.034693] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.034979] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.035229] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.035462] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-6249a178-0f24-40bf-80f5-dc2d14733531" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.056224] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.056500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.066022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.066393] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1871982-9cf3-4b58-bd63-59badb5546d2 is going to be deleted. [ 817.068426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.068741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.097351] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.097544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.100525] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.100724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.100767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.100999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.101214] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.101336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.101404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.102024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.102024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.102024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.102024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.102353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.102353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.102425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.102552] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.102673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.102737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.102849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.102977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.103064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.103162] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.104211] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.107865] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.108565] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.111705] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.121282] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00e0f7e9-6f3b-4bea-945c-76f1da468a99: rpc.has_security_group_logging(os_id): False [ 817.122595] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.141025] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.142878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.143036] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28446920-c13b-4dfc-87e9-c9f98af2604c is going to be deleted. [ 817.144041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.144287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.146324] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.146460] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.175901] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.176082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.177270] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.177408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.186698] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.188610] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.188763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.207387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.207387] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a11f256f-0ee8-49eb-88ef-2d544feb1609 is going to be deleted. [ 817.208130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.208353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.256273] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.256494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.294698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.294866] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b68d89c-9278-4047-a0c4-e471d31223ed is going to be deleted. [ 817.297342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.297739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.297900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.298139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882c622e-5e75-4cbc-a5f9-518be75e1bd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.298385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.298614] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.298715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.298880] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.299618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.299835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.299937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.300168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-202dfdd2-4f71-40b3-a725-b25d1a9dfafa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.300550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.300661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.301225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.301225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92583910-38be-424b-ae0b-e27f87da131b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.301225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.301442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.304197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.304197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e79fde6-a444-40c2-9d78-9932f7d7c5ff" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.304197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.304197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.304197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.304197] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.304197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.304197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.304197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.304197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.304197] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea is going to be deleted. [ 817.306576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.306864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.334495] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.335344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.364056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.364569] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.364789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.364789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.365047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.365208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.365327] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 is going to be updated. [ 817.366594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.366807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.366910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.367052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b47b969-b701-468c-8b2e-9e8473ecb61d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.367192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.367351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.393812] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.394089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.399893] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.400220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.400220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.400511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.400693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.400807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.402234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.402610] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.402828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.402951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.403277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.403409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.403554] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e609d95d-5be9-41f5-b37f-2462907e2f6a is going to be updated. [ 817.404772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.404983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.405139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.405428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28446920-c13b-4dfc-87e9-c9f98af2604c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.405652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.405874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.405984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.406128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1871982-9cf3-4b58-bd63-59badb5546d2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.406720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.406921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.407015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.407178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a11f256f-0ee8-49eb-88ef-2d544feb1609" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.409873] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3: rpc.has_security_group_logging(os_id): False [ 817.414319] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2102370c-50ee-4712-bad2-1dc6ac49ebb5: rpc.has_security_group_logging(os_id): False [ 817.478473] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.478660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.478731] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.480788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.481491] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.481633] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.532850] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.533101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.534587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.534864] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.535049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.535148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.535422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.535542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.535844] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.535994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.536241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.536337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.536446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.536715] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.536832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.536926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.537147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.537258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.537396] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be updated. [ 817.538995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.539242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.592537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.592922] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.593061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.593135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.593369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.593470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.593569] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 is going to be updated. [ 817.594783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.595017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.595117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.595246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b68d89c-9278-4047-a0c4-e471d31223ed" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.600636] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.600787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.600833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.601071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.601216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.607249] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc128a33-d808-470d-8d77-03637a1be1ce: rpc.has_security_group_logging(os_id): False [ 817.609015] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 522304fc-ecb3-47d1-844c-54013760964c: rpc.has_security_group_logging(os_id): False [ 817.610471] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd: rpc.has_security_group_logging(os_id): False [ 817.614574] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db9d8667-c0a3-4930-8f4b-8672f1d358e9: rpc.has_security_group_logging(os_id): False [ 817.615829] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.626258] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0fd45c4-bc5d-47a2-a08d-dfba578f269e: rpc.has_security_group_logging(os_id): False [ 817.631735] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: IN_PROGRESS for 2s [ 817.646180] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea: rpc.has_security_group_logging(os_id): False [ 817.669446] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.669759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.669924] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.670278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.680908] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.681047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.681506] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.681606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.690799] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.690899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.691223] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e609d95d-5be9-41f5-b37f-2462907e2f6a: rpc.has_security_group_logging(os_id): False [ 817.719027] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.719027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.744762] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.745057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.745759] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.745930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.756189] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.756520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.758672] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.759136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.759299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.759417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.759730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.759940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.760079] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e is going to be updated. [ 817.761266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.761466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.770670] env[66854]: INFO networking_nsxv3.common.synchronization [req-ced821aa-fa47-436c-b072-d7fbc6c36080 req-756ce17b-53eb-4b59-a9c1-7d497666d813 service nova] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 817.770879] env[66854]: INFO networking_nsxv3.common.synchronization [req-ced821aa-fa47-436c-b072-d7fbc6c36080 req-756ce17b-53eb-4b59-a9c1-7d497666d813 service nova] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 817.771037] env[66854]: INFO networking_nsxv3.common.synchronization [req-ced821aa-fa47-436c-b072-d7fbc6c36080 req-756ce17b-53eb-4b59-a9c1-7d497666d813 service nova] Enqueued Resource ID: 6249a178-0f24-40bf-80f5-dc2d14733531 with Priority: HIGHEST for action port [ 817.772226] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 817.772392] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 817.772497] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6249a178-0f24-40bf-80f5-dc2d14733531 with Priority: HIGHEST for action port [ 817.772804] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.775493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.775493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.775493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.775493] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.775493] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.775493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.775493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.775493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.775493] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.775493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.775493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.775493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.775493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.775493] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.776273] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-6249a178-0f24-40bf-80f5-dc2d14733531 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.776545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6249a178-0f24-40bf-80f5-dc2d14733531" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.776545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6249a178-0f24-40bf-80f5-dc2d14733531" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.776661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6249a178-0f24-40bf-80f5-dc2d14733531" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.776661] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6249a178-0f24-40bf-80f5-dc2d14733531',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.791145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.791333] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.791468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.791590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.791948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.792128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.792287] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 is going to be updated. [ 817.793457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.793654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.802767] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.803549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.806918] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.807091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.821332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.821783] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.822051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.822204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.822421] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.822541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.822658] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd is going to be updated. [ 817.824428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.824689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.824825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.825409] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.825409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.825409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.825614] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.825727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.825816] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea is going to be created. [ 817.827223] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.827430] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.827527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.827875] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.827987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.828110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.828318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.828459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.828561] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e609d95d-5be9-41f5-b37f-2462907e2f6a is going to be updated. [ 817.830863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.830989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.831083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.832213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.832372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.898712] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea], does not exist path=[/infra/domains/default/groups/42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea]."\n}' [ 817.898936] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea [ 817.899104] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 817.909089] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 in Status: IN_PROGRESS for 2s [ 817.934168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.934507] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.934640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.934712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.934925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.935024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.935226] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.935328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.935393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.935551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.935629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.935849] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.935905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.935966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.936348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.936493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.936593] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be updated. [ 817.940387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.940387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.940387] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.940387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.973627] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.973761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.998025] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.998025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.998025] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.998025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.017493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.017908] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.017908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.018225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.018459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.018459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.018459] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 522304fc-ecb3-47d1-844c-54013760964c is going to be updated. [ 818.019766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.019847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.020053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.021140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.021279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.021490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.022506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.022783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.022924] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.024014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.024323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.024474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.026711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.026711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.026711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.027863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.028046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.028636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.028928] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.029084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.029165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.029351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.029443] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.029697] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.029804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.029906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.030080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.030170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.030274] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea is going to be created. [ 818.071398] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 in Status: IN_PROGRESS for 2s [ 818.071398] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 in Status: IN_PROGRESS for 2s [ 818.080674] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.081461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.081461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.081461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.081689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.084381] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: IN_PROGRESS for 2s [ 818.086829] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: IN_PROGRESS for 2s [ 818.102640] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 818.113271] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea], does not exist path=[/infra/domains/default/groups/42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea [ 818.113667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.114311] env[66854]: Traceback (most recent call last): [ 818.114311] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 818.114311] env[66854]: return func(*args, **kwargs) [ 818.114499] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 818.114499] env[66854]: res.raise_for_status() [ 818.114499] env[66854]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 818.114499] env[66854]: raise HTTPError(http_error_msg, response=self) [ 818.114499] env[66854]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea [ 818.114499] env[66854]: During handling of the above exception, another exception occurred: [ 818.114499] env[66854]: Traceback (most recent call last): [ 818.114499] env[66854]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 818.114499] env[66854]: listener.cb(fileno) [ 818.114499] env[66854]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 818.114499] env[66854]: result = function(*args, **kwargs) [ 818.114499] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 818.114499] env[66854]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 818.114499] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 818.114499] env[66854]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 818.114499] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 818.114499] env[66854]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 818.114499] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 818.114499] env[66854]: res.raise_for_status() [ 818.114499] env[66854]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 818.114499] env[66854]: raise HTTPError(http_error_msg, response=self) [ 818.114499] env[66854]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/42bf2c51-9cb0-4bb7-9f8c-fc83cd7232ea [ 818.114499] env[66854]: Removing descriptor: 19 [ 818.120825] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd in Status: IN_PROGRESS for 2s [ 818.123023] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.123023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.123023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.123023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.123023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.123023] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 818.183782] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.183782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.184050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.185197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.185197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.208192] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e in Status: SUCCESS [ 818.208535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.211057] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.211262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.211372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.211606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.212643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.214639] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 818.233988] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 818.273862] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 818.274934] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.275232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.275309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.275774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.275774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.281976] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.282406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.282406] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.283515] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6249a178-0f24-40bf-80f5-dc2d14733531 with status ACTIVE [ 818.283718] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.283899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.283986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.284250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.284353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.284576] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.284683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.284750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.284923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.285024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.285336] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.285477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.285570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.285766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.286164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.286164] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6249a178-0f24-40bf-80f5-dc2d14733531 is going to be updated. [ 818.326164] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: IN_PROGRESS for 2s [ 818.335568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.335771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.335924] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.336114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.336728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.336728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6249a178-0f24-40bf-80f5-dc2d14733531" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.718550] env[66854]: INFO networking_nsxv3.common.synchronization [req-c54d1262-c973-4e40-b859-640f24a6b175 req-65046dec-cc37-4232-bfd7-40bf8634d9d9 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 818.719288] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 818.719288] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.719288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.719466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.719503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.719780] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.720729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.720729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.720985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.721698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.721827] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.788658] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.095839] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.095839] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.096298] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.096298] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.096624] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.096796] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.096951] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.097288] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.097550] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.097918] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.098112] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.098280] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.098416] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.098559] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.098677] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.098848] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.118953] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.118953] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 819.118953] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.118953] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.119450] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-08948c0c-0f4b-4363-a575-35c6d5d20177 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.119450] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-08948c0c-0f4b-4363-a575-35c6d5d20177" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.119450] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-08948c0c-0f4b-4363-a575-35c6d5d20177" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.121829] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-08948c0c-0f4b-4363-a575-35c6d5d20177" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.121829] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08948c0c-0f4b-4363-a575-35c6d5d20177',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.122317] env[66854]: INFO networking_nsxv3.common.synchronization [None req-a7b94f0f-80a8-4d6b-ae26-7005d88cea6f None None] Enqueued Resource ID: db4af689-62ba-402d-be1a-e11e065c110a with Priority: HIGHEST for action port [ 819.123070] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4af689-62ba-402d-be1a-e11e065c110a with Priority: HIGHEST for action port [ 819.123375] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-db4af689-62ba-402d-be1a-e11e065c110a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.123837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db4af689-62ba-402d-be1a-e11e065c110a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.123837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db4af689-62ba-402d-be1a-e11e065c110a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.123837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db4af689-62ba-402d-be1a-e11e065c110a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.124066] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db4af689-62ba-402d-be1a-e11e065c110a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.226133] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.226339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.226389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.226583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.226679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.226889] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.226993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.227070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.228138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.229611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.229770] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be deleted. [ 819.261875] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.262107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.262166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.262340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.262433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.262533] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.291681] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.291815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.291863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.292115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.292210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.292316] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be created. [ 819.319182] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.319677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.319677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.319677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.319939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.336630] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: UNINITIALIZED for 2s [ 819.625421] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.625421] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.625421] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.625593] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.625763] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.626015] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 08948c0c-0f4b-4363-a575-35c6d5d20177 not found, creating... [ 819.626452] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.626720] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.626938] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.627313] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.627531] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.628014] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.628270] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.628467] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.628792] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.629428] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.629428] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 08948c0c-0f4b-4363-a575-35c6d5d20177 is going to be created. [ 819.630921] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db4af689-62ba-402d-be1a-e11e065c110a [ 819.631198] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.631372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.631473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.631710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.631839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.631986] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db4af689-62ba-402d-be1a-e11e065c110a already deleted. [ 819.632118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db4af689-62ba-402d-be1a-e11e065c110a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.645764] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: SUCCESS [ 819.645764] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e609d95d-5be9-41f5-b37f-2462907e2f6a deletion is rescheduled due to dependency. [ 819.645764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.654576] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.654817] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.654944] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.655338] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.655583] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.655837] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-08948c0c-0f4b-4363-a575-35c6d5d20177" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.923116] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 in Status: SUCCESS [ 819.923396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.088450] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 in Status: SUCCESS [ 820.088450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.089570] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 in Status: SUCCESS [ 820.089659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.121919] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e609d95d-5be9-41f5-b37f-2462907e2f6a in Status: SUCCESS [ 820.123479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.131851] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: SUCCESS [ 820.131851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.139108] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 820.139347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.144801] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd in Status: SUCCESS [ 820.145038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.249784] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 820.250102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.265042] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.265042] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.265042] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.265042] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.265042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.266268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.266268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.266268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.266268] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.344737] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: SUCCESS [ 820.345060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.480309] env[66854]: INFO networking_nsxv3.common.synchronization [req-c54d1262-c973-4e40-b859-640f24a6b175 req-a08f04f7-0b14-4e11-bca7-7b7b00880749 service nova] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_rules [ 820.480540] env[66854]: INFO networking_nsxv3.common.synchronization [req-c54d1262-c973-4e40-b859-640f24a6b175 req-a08f04f7-0b14-4e11-bca7-7b7b00880749 service nova] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 820.480644] env[66854]: INFO networking_nsxv3.common.synchronization [req-c54d1262-c973-4e40-b859-640f24a6b175 req-a08f04f7-0b14-4e11-bca7-7b7b00880749 service nova] Enqueued Resource ID: 08948c0c-0f4b-4363-a575-35c6d5d20177 with Priority: HIGHEST for action port [ 820.481227] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_rules [ 820.481385] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 820.481508] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08948c0c-0f4b-4363-a575-35c6d5d20177 with Priority: HIGHEST for action port [ 820.482794] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.482946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.483035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.483236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.483320] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.484241] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.484378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.484482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.484685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.484848] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.484947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.485025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.485174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.485259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.487075] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.487075] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-08948c0c-0f4b-4363-a575-35c6d5d20177 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.487075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08948c0c-0f4b-4363-a575-35c6d5d20177" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.487075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08948c0c-0f4b-4363-a575-35c6d5d20177" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.487075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08948c0c-0f4b-4363-a575-35c6d5d20177" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.487075] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08948c0c-0f4b-4363-a575-35c6d5d20177',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.773459] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87b57f10-d9c1-422b-ae4f-428ffd202f74: rpc.has_security_group_logging(os_id): False [ 820.794964] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.795669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.795755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.796043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.819499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.819499] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.819499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.819499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.822390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.822390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.822390] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.822390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.822390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.822390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.822621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.823906] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.823906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.823906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.823906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.823906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.823906] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 820.896027] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.896166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.896230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.896445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.896590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.918937] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 820.988916] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.988990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.989284] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.990337] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08948c0c-0f4b-4363-a575-35c6d5d20177 with status ACTIVE [ 820.992249] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.992249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.992249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.992249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.992249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.992249] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.992468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.992468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.992526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.992556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.994076] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.994316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.995616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.995616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.995616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.995616] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08948c0c-0f4b-4363-a575-35c6d5d20177 is going to be updated. [ 821.033204] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.035297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.035297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.035297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.035297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.035297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08948c0c-0f4b-4363-a575-35c6d5d20177" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.348872] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 821.349726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.349726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.349726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.349959] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.349959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.349959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.350186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.352856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.352856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.352856] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.497766] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.545664] env[66854]: INFO networking_nsxv3.common.synchronization [req-562eb144-93db-41a1-b252-6591edaa4e82 req-134d8db4-a74e-4bb6-afbc-1932ba1b42fa tempest-MigrationsAdminTest-1593966740 tempest-MigrationsAdminTest-1593966740-project-member] Enqueued Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 821.545924] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 821.546470] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.546648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.546766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.547217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.547473] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.548114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.548114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.548114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.548114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.548619] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.808054] env[66854]: INFO networking_nsxv3.common.synchronization [None req-6c00261b-467e-4a3d-b688-1fc10193a9ba None None] Enqueued Resource ID: f5e8734e-f2c8-4323-978c-b34df622e1af with Priority: HIGHEST for action port [ 821.808959] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e8734e-f2c8-4323-978c-b34df622e1af with Priority: HIGHEST for action port [ 821.809614] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5e8734e-f2c8-4323-978c-b34df622e1af taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.809964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5e8734e-f2c8-4323-978c-b34df622e1af" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.809964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5e8734e-f2c8-4323-978c-b34df622e1af" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.810129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5e8734e-f2c8-4323-978c-b34df622e1af" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.810235] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e8734e-f2c8-4323-978c-b34df622e1af',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.857483] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.995773] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.996105] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.996291] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.996600] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.996947] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.997211] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.997390] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.997723] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.997938] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.998221] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.998397] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.998577] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.998743] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.999253] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.999502] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.999833] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.002552] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.002776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.002941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.003327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.003492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.003715] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be created. [ 822.029143] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.029143] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.029143] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.029143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.029143] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-a602789d-1a4b-49af-90b8-bf0bde794bc1 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.029143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-a602789d-1a4b-49af-90b8-bf0bde794bc1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.029143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-a602789d-1a4b-49af-90b8-bf0bde794bc1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.029143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-a602789d-1a4b-49af-90b8-bf0bde794bc1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.029143] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a602789d-1a4b-49af-90b8-bf0bde794bc1',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.034349] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.034521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.034594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.034800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.034962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.046419] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: UNINITIALIZED for 2s [ 822.050344] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.304494] env[66854]: INFO networking_nsxv3.common.synchronization [req-db268ff2-fed4-4146-a5ec-e69107e24ae8 req-c997d51f-c710-4cdd-ba37-e524903385e1 tempest-ListServersNegativeTestJSON-1804165574 tempest-ListServersNegativeTestJSON-1804165574-project-member] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 822.308538] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 822.308538] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.308538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.308538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.308538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.308538] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.308538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.308538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.308538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.308538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.308538] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.315385] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5e8734e-f2c8-4323-978c-b34df622e1af [ 822.315385] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.315385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.315385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.315385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.315385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.315385] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5e8734e-f2c8-4323-978c-b34df622e1af already deleted. [ 822.315385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5e8734e-f2c8-4323-978c-b34df622e1af" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.361738] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f976c-9aad-49d6-90f2-cd04bf828754: rpc.has_security_group_logging(os_id): False [ 822.394493] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.394729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.394835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.395167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.395303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.395668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.395817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.395914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.396417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.396417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.396524] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be created. [ 822.475087] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.475087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.475087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.475087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.475087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.489442] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 822.531839] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.532244] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.532332] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.532627] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.534390] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.534390] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port a602789d-1a4b-49af-90b8-bf0bde794bc1 not found, creating... [ 822.534390] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.534390] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.534390] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.534390] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.534390] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.534390] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.534839] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.534839] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.534839] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.534958] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.535490] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: a602789d-1a4b-49af-90b8-bf0bde794bc1 is going to be created. [ 822.552876] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.563499] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.563763] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.563891] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.564237] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.564481] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.564732] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-a602789d-1a4b-49af-90b8-bf0bde794bc1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.811061] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.823345] env[66854]: INFO networking_nsxv3.common.synchronization [None req-190375e6-24fc-4ed1-95fb-3f4343a3fedb tempest-ServerRescueNegativeTestJSON-1659784790 tempest-ServerRescueNegativeTestJSON-1659784790-project-member] Enqueued Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_rules [ 822.824888] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_rules [ 822.825514] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.825956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.825956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.826233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.826363] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.938890] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 822.939350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.939350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.939705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.939771] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.946780] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e3082f28-0d95-4b56-90c0-d3a3df6ca3ec tempest-ServerRescueNegativeTestJSON-1659784790 tempest-ServerRescueNegativeTestJSON-1659784790-project-member] Enqueued Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_rules [ 822.947512] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_rules [ 822.947939] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.948095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.055561] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.055730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.055798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.056085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.056163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.056274] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 is going to be updated. [ 823.097403] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.097646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.097796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.098015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.098358] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.113293] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: IN_PROGRESS for 2s [ 823.302370] env[66854]: INFO networking_nsxv3.common.synchronization [req-562eb144-93db-41a1-b252-6591edaa4e82 req-a4730194-a660-4b81-b2c8-6980f7b4e83a service nova] Enqueued Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_rules [ 823.302370] env[66854]: INFO networking_nsxv3.common.synchronization [req-562eb144-93db-41a1-b252-6591edaa4e82 req-a4730194-a660-4b81-b2c8-6980f7b4e83a service nova] Enqueued Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 823.302370] env[66854]: INFO networking_nsxv3.common.synchronization [req-562eb144-93db-41a1-b252-6591edaa4e82 req-a4730194-a660-4b81-b2c8-6980f7b4e83a service nova] Enqueued Resource ID: a602789d-1a4b-49af-90b8-bf0bde794bc1 with Priority: HIGHEST for action port [ 823.303015] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_rules [ 823.303015] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 823.303497] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a602789d-1a4b-49af-90b8-bf0bde794bc1 with Priority: HIGHEST for action port [ 823.303862] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.304019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.304090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.304348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.304402] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.306587] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.306587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.306587] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-a602789d-1a4b-49af-90b8-bf0bde794bc1 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.306587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a602789d-1a4b-49af-90b8-bf0bde794bc1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.306587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a602789d-1a4b-49af-90b8-bf0bde794bc1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.306890] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a602789d-1a4b-49af-90b8-bf0bde794bc1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.308019] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a602789d-1a4b-49af-90b8-bf0bde794bc1',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.313239] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.379305] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.379711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.379711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.379711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.379821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.379950] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 already deleted. [ 823.380057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.380323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.380579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.380709] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.442290] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.442464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.442538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.442760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.442930] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.444729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.444905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.445142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.445239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.445411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.445470] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.623214] env[66854]: INFO networking_nsxv3.common.synchronization [req-34a7410b-7b18-4429-a282-381bdf587f11 req-94ea082e-9ce3-4784-8b4a-ab4eeb59c956 tempest-ServersAdminNegativeTestJSON-44301001 tempest-ServersAdminNegativeTestJSON-44301001-project-member] Enqueued Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 823.623214] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 823.623214] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.623742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.623971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.624298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.624643] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.625092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.625277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.625582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.625766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.625950] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.807396] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.807596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.809160] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a602789d-1a4b-49af-90b8-bf0bde794bc1 with status ACTIVE [ 823.809445] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.810716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.810716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.810716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.810716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.810716] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.810716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.810716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.811488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.811488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.811755] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.811929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.812065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.812885] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.812885] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.812885] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a602789d-1a4b-49af-90b8-bf0bde794bc1 is going to be updated. [ 823.817454] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.817583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.817670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.817837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.817918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.818017] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be updated. [ 823.851875] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.851875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.851875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.851875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.851875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.851875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a602789d-1a4b-49af-90b8-bf0bde794bc1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.857494] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.857746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.857746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.857952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.858101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.870055] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 823.910966] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.911353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.911524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.911828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.913232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.913330] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 already deleted. [ 823.913450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.948090] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.948413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.948557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.948867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.949209] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.949372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.949476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.949741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.949877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.950059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.950427] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.950556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.950666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.950931] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.951218] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.951381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.951499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.951732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.951860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.952013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.952163] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.066313] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 824.066313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.066313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.066313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.066313] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.066313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.066313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.066313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.066313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.066313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.067130] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.128997] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.408904] env[66854]: INFO networking_nsxv3.common.synchronization [req-320fa996-68b5-4a22-8b28-8d529e45eb8e req-724bdbcf-effa-4af6-8a8d-a7552d913d3f tempest-ListServersNegativeTestJSON-1804165574 tempest-ListServersNegativeTestJSON-1804165574-project-member] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 824.409457] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGHEST for action security_group_members [ 824.410490] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.410598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.415758] env[66854]: INFO networking_nsxv3.common.synchronization [req-6902e618-72aa-456e-a83f-f1769eb02edb req-85f08946-78b1-4793-b56e-cf875eab3f40 tempest-ServerPasswordTestJSON-722629858 tempest-ServerPasswordTestJSON-722629858-project-member] Enqueued Resource ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 with Priority: HIGHEST for action security_group_members [ 824.416011] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 with Priority: HIGHEST for action security_group_members [ 824.416543] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff920ada-bbb9-444b-aa0c-7044b7d9d450 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.416687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.416793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.417077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.417247] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.417351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.417411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.417579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.417820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.417923] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff920ada-bbb9-444b-aa0c-7044b7d9d450',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.455724] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87b57f10-d9c1-422b-ae4f-428ffd202f74: rpc.has_security_group_logging(os_id): False [ 824.495738] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.496048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.496120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.499910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.500102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.500352] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.500482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.500547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.500700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.500772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.500985] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.501094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.501142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.502130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.502130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.502130] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.502130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.502130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.502130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.502130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.502130] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 824.505585] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 824.505808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.571755] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.571912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.571990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.572260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.572448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.572557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.572624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.572779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.572865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.572955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.573125] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.573220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.573284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.573429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.573572] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.573662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.573724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.573859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.573936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.576478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.576594] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.599489] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.599637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.599707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.599917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.600078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.621631] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 824.630952] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.805975] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-960 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.806258] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-960" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.806388] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-960" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.806760] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-960" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.807572] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.807739] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.807859] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.808093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.808238] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.808449] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.808561] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.808667] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.808791] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.808893] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.808995] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.809141] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.829698] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.829698] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 824.829698] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.829992] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-960" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.830424] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-0612fa2f-3c48-44d2-a885-78786f46d55c taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.830650] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-0612fa2f-3c48-44d2-a885-78786f46d55c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.830802] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-0612fa2f-3c48-44d2-a885-78786f46d55c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.831231] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-0612fa2f-3c48-44d2-a885-78786f46d55c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.831339] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0612fa2f-3c48-44d2-a885-78786f46d55c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.920645] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.924242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.924450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.925103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.925103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.925487] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.925663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.925747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.925939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.926087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.926230] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 already deleted. [ 824.926367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.081562] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ccc5a4-8c8a-445b-b37a-462c691c3639: rpc.has_security_group_logging(os_id): False [ 825.105028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.105028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.105028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.105028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.105028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.105028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.105028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.105748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.106472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.109511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.109511] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.109511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.109511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.109511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.109511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.109511] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.109511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.109511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.109511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.109511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.110616] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be created. [ 825.128584] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: SUCCESS [ 825.129388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.130144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.130492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.130955] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.134024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.134024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.134024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.134024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.134024] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.134024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.134024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.134024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.139865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.139865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.139865] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e is going to be updated. [ 825.197851] env[66854]: INFO networking_nsxv3.common.synchronization [req-5134f7c0-53c1-4920-ad72-75dfedae2262 req-005db1d2-797b-4f81-a555-c63b930d3ed2 tempest-ImagesOneServerNegativeTestJSON-1585579513 tempest-ImagesOneServerNegativeTestJSON-1585579513-project-member] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 825.198338] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 825.198735] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.198922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.199044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.199453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.199539] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.203035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.203035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.203035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.203035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.203035] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.323415] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.323589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.323704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.323973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.324190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.334406] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.334646] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.334902] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.335175] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.335324] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.335476] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 0612fa2f-3c48-44d2-a885-78786f46d55c not found, creating... [ 825.336043] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.336043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.336043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.336305] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.336364] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.336637] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.336790] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.336903] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.337114] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.337247] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.337382] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 0612fa2f-3c48-44d2-a885-78786f46d55c is going to be created. [ 825.345196] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: IN_PROGRESS for 2s [ 825.363061] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.363225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.363308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.363559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.363748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.366112] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.366308] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.366428] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.366713] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.367028] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.368101] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-0612fa2f-3c48-44d2-a885-78786f46d55c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.392528] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 825.640070] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.668034] env[66854]: INFO networking_nsxv3.common.synchronization [req-6ed8d216-6dc7-484c-b590-be1ffec2658c req-afedf950-a0e5-4aea-92d7-0a81d3ebef8f tempest-InstanceActionsNegativeTestJSON-1267599867 tempest-InstanceActionsNegativeTestJSON-1267599867-project-member] Enqueued Resource ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e with Priority: HIGHEST for action security_group_members [ 825.668717] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e with Priority: HIGHEST for action security_group_members [ 825.669038] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-9780d851-7ce4-4e40-ae84-ac55f3124f1e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.669162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.669227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.669428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.669887] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.669996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.670074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.670244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.670333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.670554] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9780d851-7ce4-4e40-ae84-ac55f3124f1e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.706373] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.706513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.706552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.706823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.706925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.707153] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.707254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.707329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.707600] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.707676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.707805] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be updated. [ 825.743633] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.743830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.743893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.744112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.744264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.756821] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 825.882521] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 825.882679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.882832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.883073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.883315] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.883406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.883467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.883654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.883739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.883842] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.142673] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.144969] env[66854]: INFO networking_nsxv3.common.synchronization [req-6902e618-72aa-456e-a83f-f1769eb02edb req-d21c4c2d-364c-40fe-a1aa-7989533d3d77 service nova] Enqueued Resource ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 with Priority: HIGHEST for action security_group_rules [ 826.144969] env[66854]: INFO networking_nsxv3.common.synchronization [req-6902e618-72aa-456e-a83f-f1769eb02edb req-d21c4c2d-364c-40fe-a1aa-7989533d3d77 service nova] Enqueued Resource ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 with Priority: HIGHEST for action security_group_members [ 826.145253] env[66854]: INFO networking_nsxv3.common.synchronization [req-6902e618-72aa-456e-a83f-f1769eb02edb req-d21c4c2d-364c-40fe-a1aa-7989533d3d77 service nova] Enqueued Resource ID: 0612fa2f-3c48-44d2-a885-78786f46d55c with Priority: HIGHEST for action port [ 826.145991] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 with Priority: HIGHEST for action security_group_rules [ 826.145991] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 with Priority: HIGHEST for action security_group_members [ 826.146224] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0612fa2f-3c48-44d2-a885-78786f46d55c with Priority: HIGHEST for action port [ 826.146409] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff920ada-bbb9-444b-aa0c-7044b7d9d450 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.146727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.146727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.146917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.147021] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff920ada-bbb9-444b-aa0c-7044b7d9d450',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.147892] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff920ada-bbb9-444b-aa0c-7044b7d9d450 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.148107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.148209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.148488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.148627] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.151772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.151772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.151772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.151772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.151772] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff920ada-bbb9-444b-aa0c-7044b7d9d450',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.151772] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-0612fa2f-3c48-44d2-a885-78786f46d55c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.151772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0612fa2f-3c48-44d2-a885-78786f46d55c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.151772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0612fa2f-3c48-44d2-a885-78786f46d55c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.151772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0612fa2f-3c48-44d2-a885-78786f46d55c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.151772] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0612fa2f-3c48-44d2-a885-78786f46d55c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.171909] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.172108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.172194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.172435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.202102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.202375] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.202528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.202606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.202819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.202910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.203013] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e is going to be updated. [ 826.235240] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.235413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.235463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.237290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.237290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.247851] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e in Status: IN_PROGRESS for 2s [ 826.389673] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.389898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.389966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.390194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.416149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.416464] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.416806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.416919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.417179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.417304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.417414] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be updated. [ 826.452338] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.452658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.452658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.452888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.453270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.463738] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: IN_PROGRESS for 2s [ 826.646389] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.646688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.646688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.646852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.646947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.647350] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 is going to be updated. [ 826.653942] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff920ada-bbb9-444b-aa0c-7044b7d9d450',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.654504] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff920ada-bbb9-444b-aa0c-7044b7d9d450 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.654664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.656557] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 826.656557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.656942] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0612fa2f-3c48-44d2-a885-78786f46d55c with status ACTIVE [ 826.657089] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.657190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.657228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.657438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.657578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.658136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.658136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.658136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.658136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.658461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.658461] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.658539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.658682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.658745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.658811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.658898] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0612fa2f-3c48-44d2-a885-78786f46d55c is going to be updated. [ 826.694791] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.694791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.694791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.694791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.694791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.696394] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.696516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.696585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.696751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.696870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.697032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0612fa2f-3c48-44d2-a885-78786f46d55c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.706338] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: IN_PROGRESS for 2s [ 827.156287] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff920ada-bbb9-444b-aa0c-7044b7d9d450',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.356347] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: SUCCESS [ 827.356591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.411626] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 827.411966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.662084] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.662084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.662084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.662084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.662084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.662084] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 is going to be created. [ 827.691243] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.691416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.691468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.691651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.691813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.705829] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 in Status: UNINITIALIZED for 2s [ 827.767241] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 827.767460] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce deletion is rescheduled due to dependency. [ 827.767588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.265035] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e in Status: IN_PROGRESS for 4s [ 828.478903] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 in Status: SUCCESS [ 828.479177] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 deletion is rescheduled due to dependency. [ 828.479327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.717125] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: SUCCESS [ 828.717436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.717531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.717735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.717930] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.718063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.718128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.718285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.718368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.718453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.718954] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.221193] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.221390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.221434] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.221646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.221815] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.221943] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.221997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.222188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.222278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.222370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.222526] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.222621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.222704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.222833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.222977] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.223110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.223285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.223419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.223500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.223585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.223700] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.498423] env[66854]: INFO networking_nsxv3.common.synchronization [req-595583d2-d0b2-4eae-a1f3-2899e449ca1a req-d8d47ba0-df6d-41f3-8de6-4de59a4a9d7d tempest-ServerMetadataNegativeTestJSON-650407574 tempest-ServerMetadataNegativeTestJSON-650407574-project-member] Enqueued Resource ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c with Priority: HIGHEST for action security_group_members [ 829.504049] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c with Priority: HIGHEST for action security_group_members [ 829.504049] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-093ca7de-ad54-41b2-b5ea-68254c34b27c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.504049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.504049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.504049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.504049] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.504049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.504049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.504049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.504049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.504049] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093ca7de-ad54-41b2-b5ea-68254c34b27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.719331] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 in Status: SUCCESS [ 829.719331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.719331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.719331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.719331] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.719331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.719331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.719331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.719331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.719331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.723201] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff920ada-bbb9-444b-aa0c-7044b7d9d450',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.732056] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7025fd1c-e490-40e6-9db4-8ead9e399bb5: rpc.has_security_group_logging(os_id): False [ 829.752120] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.752120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.752120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.752120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.775349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.775630] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.775802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.775867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.776041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.776129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.776345] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.776447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.776512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.776665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.776741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.776923] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.777025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.777085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.777240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.777293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.777390] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 is going to be updated. [ 829.842394] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.842497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.842537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.842827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.843013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.859126] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: IN_PROGRESS for 2s [ 829.878096] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.878318] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-691" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.878418] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-691" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.879031] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-691" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.879284] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.879443] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.879558] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.879787] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.879930] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.880209] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.880333] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.880442] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.880547] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.880670] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.880848] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.880998] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.900303] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.900467] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.900604] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.900835] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-691" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.901174] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-79d14633-9637-42aa-aa46-4fae3dcabdd0 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.901342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-79d14633-9637-42aa-aa46-4fae3dcabdd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.901462] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-79d14633-9637-42aa-aa46-4fae3dcabdd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.901778] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-79d14633-9637-42aa-aa46-4fae3dcabdd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.901921] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79d14633-9637-42aa-aa46-4fae3dcabdd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.006910] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.007170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.007281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.007563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.008208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.010109] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.010220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.010220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.011044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.011044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.011044] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c already deleted. [ 830.011044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.222362] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff920ada-bbb9-444b-aa0c-7044b7d9d450 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.222550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.222615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.222923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.223028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.223089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.223163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.223332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.223421] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.223510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.223662] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff920ada-bbb9-444b-aa0c-7044b7d9d450 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.227020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.227020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.227020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.227020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.227020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.227020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.227020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.227020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.227020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.227020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff920ada-bbb9-444b-aa0c-7044b7d9d450',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.274418] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e in Status: SUCCESS [ 830.275666] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e deletion is rescheduled due to dependency. [ 830.275666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.407096] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.408032] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.408032] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.408032] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.408032] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.408482] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 79d14633-9637-42aa-aa46-4fae3dcabdd0 not found, creating... [ 830.408482] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.408685] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.408776] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.409009] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.409149] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.409437] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.409593] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.409738] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.410243] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.410243] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.410546] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 79d14633-9637-42aa-aa46-4fae3dcabdd0 is going to be created. [ 830.437655] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.437655] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.438085] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.438085] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.438499] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.438645] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-79d14633-9637-42aa-aa46-4fae3dcabdd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.727455] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff920ada-bbb9-444b-aa0c-7044b7d9d450: rpc.has_security_group_logging(os_id): False [ 830.755529] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.755649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.755649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.755820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.755907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.756117] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.756224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.756305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.756423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.756518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.756734] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.756837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.756899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.757126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.757323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.757537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.757648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.757719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.759983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.759983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.759983] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 is going to be created. [ 830.831996] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.831996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.832195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.832247] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.832433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.846503] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 in Status: IN_PROGRESS for 2s [ 831.214881] env[66854]: INFO networking_nsxv3.common.synchronization [req-595583d2-d0b2-4eae-a1f3-2899e449ca1a req-cf7cb599-b1d5-46c8-904f-1b99b9d6be3b service nova] Enqueued Resource ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c with Priority: HIGHEST for action security_group_rules [ 831.215098] env[66854]: INFO networking_nsxv3.common.synchronization [req-595583d2-d0b2-4eae-a1f3-2899e449ca1a req-cf7cb599-b1d5-46c8-904f-1b99b9d6be3b service nova] Enqueued Resource ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c with Priority: HIGHEST for action security_group_members [ 831.215936] env[66854]: INFO networking_nsxv3.common.synchronization [req-595583d2-d0b2-4eae-a1f3-2899e449ca1a req-cf7cb599-b1d5-46c8-904f-1b99b9d6be3b service nova] Enqueued Resource ID: 79d14633-9637-42aa-aa46-4fae3dcabdd0 with Priority: HIGHEST for action port [ 831.215936] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c with Priority: HIGHEST for action security_group_rules [ 831.216126] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c with Priority: HIGHEST for action security_group_members [ 831.216299] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79d14633-9637-42aa-aa46-4fae3dcabdd0 with Priority: HIGHEST for action port [ 831.217246] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-093ca7de-ad54-41b2-b5ea-68254c34b27c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.217246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.217246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.217246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.217246] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('093ca7de-ad54-41b2-b5ea-68254c34b27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.218563] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-093ca7de-ad54-41b2-b5ea-68254c34b27c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.218919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.218919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.219041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.219274] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.219381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.219446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.219601] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.219688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.219784] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093ca7de-ad54-41b2-b5ea-68254c34b27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.220627] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-79d14633-9637-42aa-aa46-4fae3dcabdd0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.220693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79d14633-9637-42aa-aa46-4fae3dcabdd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.220750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79d14633-9637-42aa-aa46-4fae3dcabdd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.220883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79d14633-9637-42aa-aa46-4fae3dcabdd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.220960] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79d14633-9637-42aa-aa46-4fae3dcabdd0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.723546] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-093ca7de-ad54-41b2-b5ea-68254c34b27c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.723706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.723983] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('093ca7de-ad54-41b2-b5ea-68254c34b27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.724932] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79d14633-9637-42aa-aa46-4fae3dcabdd0 with status ACTIVE [ 831.725152] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.725263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.725309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.726592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.726592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.726592] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.726592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.726592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.726592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.726592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.726592] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.726592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.726592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.726994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.726994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.726994] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79d14633-9637-42aa-aa46-4fae3dcabdd0 is going to be updated. [ 831.761501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.761879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.761879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.762042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.762143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.762320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79d14633-9637-42aa-aa46-4fae3dcabdd0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.887382] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: SUCCESS [ 831.887382] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.229082] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('093ca7de-ad54-41b2-b5ea-68254c34b27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.731658] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.731859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.731959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.732361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.732484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.732619] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c is going to be created. [ 832.761483] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.761915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.761915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.762083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.762314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.774603] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c in Status: UNINITIALIZED for 2s [ 832.860540] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 in Status: SUCCESS [ 832.860826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.785125] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c in Status: SUCCESS [ 834.785480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.785521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.785720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.785920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.786060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.786117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.786272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.786355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.786440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.786535] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('093ca7de-ad54-41b2-b5ea-68254c34b27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.288774] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-093ca7de-ad54-41b2-b5ea-68254c34b27c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.289888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.290064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.290315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.290517] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.290632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.290701] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.290887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.290961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.291086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.291277] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-093ca7de-ad54-41b2-b5ea-68254c34b27c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.291409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.291480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.291631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.291779] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.291873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.291929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.292081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.292164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.292241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.292334] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('093ca7de-ad54-41b2-b5ea-68254c34b27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.795090] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 093ca7de-ad54-41b2-b5ea-68254c34b27c: rpc.has_security_group_logging(os_id): False [ 835.816235] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.816315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.816412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.816591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.816674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.816892] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.816983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.817053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.817212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.817288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.817463] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.817843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.817843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.817843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.817843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.820563] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.820789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.820827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.820994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.821095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.821186] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c is going to be created. [ 835.892944] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.894897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.894897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.894897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.894897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.907858] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c in Status: IN_PROGRESS for 2s [ 836.125204] env[66854]: INFO networking_nsxv3.common.synchronization [req-33e7d5d4-9063-4bed-b4db-370535e6d39c req-20f8a56a-e33a-491e-b962-89c39aa0d361 tempest-ListServerFiltersTestJSON-732493998 tempest-ListServerFiltersTestJSON-732493998-project-member] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 836.125776] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 836.126194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.126395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.126490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.127013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.127090] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.128293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.128293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.128293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.128293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.128293] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.581669] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-914 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.581906] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.582036] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.582448] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.582627] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.582801] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.582962] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.583139] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.583308] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.583552] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.583673] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.583784] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.583893] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.583997] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.584120] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.584265] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.606041] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.606041] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 836.606041] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.606041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.606576] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-db96cacc-4381-438b-8e00-a26f8c569359 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.606913] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-db96cacc-4381-438b-8e00-a26f8c569359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.606913] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-db96cacc-4381-438b-8e00-a26f8c569359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.607276] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-db96cacc-4381-438b-8e00-a26f8c569359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.607428] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db96cacc-4381-438b-8e00-a26f8c569359',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.636490] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.636804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.636891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.637057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.637157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.637373] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.637477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.637544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.637685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.637776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.637881] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b already deleted. [ 836.638166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.110268] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.110813] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.110813] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.111230] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.111589] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.111845] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port db96cacc-4381-438b-8e00-a26f8c569359 not found, creating... [ 837.112249] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.112504] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.112699] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.113124] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.113337] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.113691] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.113855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.113988] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.114254] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.114399] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.114545] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: db96cacc-4381-438b-8e00-a26f8c569359 is going to be created. [ 837.139369] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.139686] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.139848] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.140620] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.140864] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.141122] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-db96cacc-4381-438b-8e00-a26f8c569359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.915138] env[66854]: INFO networking_nsxv3.common.synchronization [req-33e7d5d4-9063-4bed-b4db-370535e6d39c req-e4b9c95e-e03b-4f49-8647-c31fb16411a9 service nova] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_rules [ 837.915532] env[66854]: INFO networking_nsxv3.common.synchronization [req-33e7d5d4-9063-4bed-b4db-370535e6d39c req-e4b9c95e-e03b-4f49-8647-c31fb16411a9 service nova] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 837.915803] env[66854]: INFO networking_nsxv3.common.synchronization [req-33e7d5d4-9063-4bed-b4db-370535e6d39c req-e4b9c95e-e03b-4f49-8647-c31fb16411a9 service nova] Enqueued Resource ID: db96cacc-4381-438b-8e00-a26f8c569359 with Priority: HIGHEST for action port [ 837.916660] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_rules [ 837.916887] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 837.917201] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db96cacc-4381-438b-8e00-a26f8c569359 with Priority: HIGHEST for action port [ 837.917681] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.917889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.918015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.918408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.918548] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.920580] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.920768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.920881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.921201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.921474] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.921640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.921739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.921986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.923523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.923632] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.925058] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-db96cacc-4381-438b-8e00-a26f8c569359 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.925232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db96cacc-4381-438b-8e00-a26f8c569359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.925314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db96cacc-4381-438b-8e00-a26f8c569359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.925588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db96cacc-4381-438b-8e00-a26f8c569359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.926091] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db96cacc-4381-438b-8e00-a26f8c569359',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.928853] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c in Status: SUCCESS [ 837.929196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.430680] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.431149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.431355] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.433609] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db96cacc-4381-438b-8e00-a26f8c569359 with status ACTIVE [ 838.433687] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.433955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.434238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.434529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.434680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.435054] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.435284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.436803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.436803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.436803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.436803] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.436803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.436803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.436803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.436803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.438990] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db96cacc-4381-438b-8e00-a26f8c569359 is going to be updated. [ 838.465175] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.465481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.465704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.465825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.468474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.468474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db96cacc-4381-438b-8e00-a26f8c569359" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.939533] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.208241] env[66854]: INFO networking_nsxv3.common.synchronization [req-1cc57cd8-43ba-4c09-9ae2-ff6e8a6868ea req-fc02ff92-b1d6-4207-9577-d801a7752ec2 tempest-ServerPasswordTestJSON-722629858 tempest-ServerPasswordTestJSON-722629858-project-member] Enqueued Resource ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 with Priority: HIGHEST for action security_group_members [ 839.208808] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 with Priority: HIGHEST for action security_group_members [ 839.209169] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff920ada-bbb9-444b-aa0c-7044b7d9d450 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.209292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.209357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.209679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.209720] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.209826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.209887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.210236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.210236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.210236] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff920ada-bbb9-444b-aa0c-7044b7d9d450',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.442679] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.443125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.443125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.443419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.443627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.443795] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be created. [ 839.476028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.476269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.476269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.476451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.476807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.488181] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: UNINITIALIZED for 2s [ 839.714082] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.714082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.714258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.714344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.714398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.714618] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.714763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.714841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.714981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.715074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.715161] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 is going to be updated. [ 839.749053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.749222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.749307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.749509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.749670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.760088] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 in Status: IN_PROGRESS for 2s [ 841.501051] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 841.501407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.501481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.501709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.501917] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.502048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.502124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.502268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.502346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.502460] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.502566] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.771492] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 in Status: SUCCESS [ 841.771661] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 deletion is rescheduled due to dependency. [ 841.771814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.005581] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.005870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.005990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.006258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.006489] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.006661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.006745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.006940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.007142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.007248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.007432] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.007541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.007616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.007781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.007951] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.008055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.008128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.008284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.008362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.008476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.008591] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.512260] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1466949f-e84c-4398-88b8-456cc5ec401b: rpc.has_security_group_logging(os_id): False [ 842.535409] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.535619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.535702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.536355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.536355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.536558] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.536683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.536849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.537017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.537129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.537386] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.537487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.537582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.537785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.537954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.538160] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.538267] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.538344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.538486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.538583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.538671] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be created. [ 842.608710] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.608891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.608969] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.609255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.609479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.621798] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: IN_PROGRESS for 2s [ 843.694096] env[66854]: INFO networking_nsxv3.common.synchronization [req-0a43fc21-59d5-4d71-8704-a31bedbf39fd req-baaf2dbf-2743-4250-b847-5b3af50c0572 tempest-ServerAddressesNegativeTestJSON-1164281620 tempest-ServerAddressesNegativeTestJSON-1164281620-project-member] Enqueued Resource ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c with Priority: HIGHEST for action security_group_members [ 843.694661] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c with Priority: HIGHEST for action security_group_members [ 843.695676] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d10cc-b324-427e-8dd3-5c42afadf27c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.695845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.695951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.696202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.696379] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.696484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.696972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.696972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.696972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.696972] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2d10cc-b324-427e-8dd3-5c42afadf27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.053281] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-683 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.053480] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-683" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.053586] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-683" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.053972] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-683" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.054388] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.054538] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.054624] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.054921] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.055129] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.055369] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.055484] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.055594] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.055701] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.055835] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.055914] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.056051] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.077649] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.077769] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.078021] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.078241] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-683" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.078628] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-973021ab-cb62-4009-9580-79c6d8372c9e taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.078848] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-973021ab-cb62-4009-9580-79c6d8372c9e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.078976] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-973021ab-cb62-4009-9580-79c6d8372c9e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.079347] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-973021ab-cb62-4009-9580-79c6d8372c9e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.079535] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('973021ab-cb62-4009-9580-79c6d8372c9e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.200651] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.200651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.200651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.200651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.200651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.200651] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.201026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.201026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.201026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.201131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.201475] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c already deleted. [ 844.201475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.375244] env[66854]: INFO networking_nsxv3.common.synchronization [req-08daf6b0-cf2c-4c47-8d4b-6f2b26a4214e req-63f3812d-6769-47d9-8135-f62d4ac461d9 tempest-ServerMetadataNegativeTestJSON-650407574 tempest-ServerMetadataNegativeTestJSON-650407574-project-member] Enqueued Resource ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c with Priority: HIGHEST for action security_group_members [ 844.375244] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c with Priority: HIGHEST for action security_group_members [ 844.375244] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-093ca7de-ad54-41b2-b5ea-68254c34b27c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.375244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.375244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.375565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.375565] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.375980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.376068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.376591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.376591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.376591] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093ca7de-ad54-41b2-b5ea-68254c34b27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.582573] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.583447] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.583447] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.583447] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.583663] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.583778] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 973021ab-cb62-4009-9580-79c6d8372c9e not found, creating... [ 844.584118] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.584284] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.584397] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.584631] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.584767] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.585133] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.585223] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.585364] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.585594] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.585705] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.585842] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 973021ab-cb62-4009-9580-79c6d8372c9e is going to be created. [ 844.630568] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.631655] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.631655] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.631655] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.631655] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.631947] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-973021ab-cb62-4009-9580-79c6d8372c9e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.637014] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 844.637228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.878671] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.879067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.879067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.879273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.879329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.879548] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.879678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.879789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.879933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.880022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.880133] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c is going to be updated. [ 844.908918] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.909289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.909289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.909426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.909573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.919357] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c in Status: IN_PROGRESS for 2s [ 845.178134] env[66854]: INFO networking_nsxv3.common.synchronization [req-192ce9c3-fa57-4abc-9ae3-07582d4b90e2 req-5e587592-6a20-478b-bd87-0305659a15bc tempest-ServersAdminTestJSON-1278843131 tempest-ServersAdminTestJSON-1278843131-project-member] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 845.178778] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 845.179414] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.179717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.179821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.180155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.180441] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.180574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.180646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.180843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.180908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.181217] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.377267] env[66854]: INFO networking_nsxv3.common.synchronization [req-0a43fc21-59d5-4d71-8704-a31bedbf39fd req-459214c1-a246-4fe6-b94a-a5b15df46e64 service nova] Enqueued Resource ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c with Priority: HIGHEST for action security_group_rules [ 845.377267] env[66854]: INFO networking_nsxv3.common.synchronization [req-0a43fc21-59d5-4d71-8704-a31bedbf39fd req-459214c1-a246-4fe6-b94a-a5b15df46e64 service nova] Enqueued Resource ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c with Priority: HIGHEST for action security_group_members [ 845.377267] env[66854]: INFO networking_nsxv3.common.synchronization [req-0a43fc21-59d5-4d71-8704-a31bedbf39fd req-459214c1-a246-4fe6-b94a-a5b15df46e64 service nova] Enqueued Resource ID: 973021ab-cb62-4009-9580-79c6d8372c9e with Priority: HIGHEST for action port [ 845.377393] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c with Priority: HIGHEST for action security_group_rules [ 845.377539] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c with Priority: HIGHEST for action security_group_members [ 845.377656] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 973021ab-cb62-4009-9580-79c6d8372c9e with Priority: HIGHEST for action port [ 845.378651] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2d10cc-b324-427e-8dd3-5c42afadf27c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.379211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.379211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.379211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.379211] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2d10cc-b324-427e-8dd3-5c42afadf27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.380652] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d10cc-b324-427e-8dd3-5c42afadf27c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.380874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.381043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.381372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.381654] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.381848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.381971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.383088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.383088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.383088] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2d10cc-b324-427e-8dd3-5c42afadf27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.384170] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-973021ab-cb62-4009-9580-79c6d8372c9e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.384582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-973021ab-cb62-4009-9580-79c6d8372c9e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.384582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-973021ab-cb62-4009-9580-79c6d8372c9e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.384839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-973021ab-cb62-4009-9580-79c6d8372c9e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.384961] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('973021ab-cb62-4009-9580-79c6d8372c9e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.686020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.888215] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed2d10cc-b324-427e-8dd3-5c42afadf27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.890753] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d10cc-b324-427e-8dd3-5c42afadf27c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.890753] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.890922] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 973021ab-cb62-4009-9580-79c6d8372c9e with status ACTIVE [ 845.891114] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.891221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.891284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.891748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.891896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.892146] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.892253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.892329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.892523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.892635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.892874] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.893035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.893148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.893337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.893453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.893575] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 973021ab-cb62-4009-9580-79c6d8372c9e is going to be updated. [ 845.919049] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.919265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.919338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.919628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.919785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.919993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-973021ab-cb62-4009-9580-79c6d8372c9e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.188211] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.391393] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed2d10cc-b324-427e-8dd3-5c42afadf27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.691377] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.691517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.691592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.691768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.691851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.692042] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 846.722175] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.722315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.724058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.724058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.724058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.732646] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 846.895091] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.895091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.895091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.895091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.895091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.895091] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c is going to be created. [ 846.920022] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.920022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.920022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.920240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.920274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.929792] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c in Status: SUCCESS [ 846.929980] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c deletion is rescheduled due to dependency. [ 846.930121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.936422] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c in Status: UNINITIALIZED for 2s [ 848.614715] env[66854]: INFO networking_nsxv3.common.synchronization [None req-ce586780-fbe4-4e37-8666-4d0bc7cdcb09 None None] Enqueued Resource ID: 7a659b8f-527a-4d80-bb82-d1ba379ee20b with Priority: HIGHEST for action port [ 848.615165] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a659b8f-527a-4d80-bb82-d1ba379ee20b with Priority: HIGHEST for action port [ 848.616322] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a659b8f-527a-4d80-bb82-d1ba379ee20b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.617250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a659b8f-527a-4d80-bb82-d1ba379ee20b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.617334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a659b8f-527a-4d80-bb82-d1ba379ee20b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.617651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a659b8f-527a-4d80-bb82-d1ba379ee20b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.617767] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a659b8f-527a-4d80-bb82-d1ba379ee20b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.749450] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 848.749450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.947405] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c in Status: SUCCESS [ 848.948568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.948568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.948568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.948568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.948568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.948568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.949683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.949875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.950069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.950352] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed2d10cc-b324-427e-8dd3-5c42afadf27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.122707] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a659b8f-527a-4d80-bb82-d1ba379ee20b [ 849.123526] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.123526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.123526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.123526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.123774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.123774] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a659b8f-527a-4d80-bb82-d1ba379ee20b already deleted. [ 849.123774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a659b8f-527a-4d80-bb82-d1ba379ee20b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.457415] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d10cc-b324-427e-8dd3-5c42afadf27c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.457415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.457415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.458386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.458386] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.458561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.458561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.458743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.458778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.459022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.459087] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d10cc-b324-427e-8dd3-5c42afadf27c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.459156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.459327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.459413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.459710] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.459710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.459710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.459937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.459977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.462030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.462030] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed2d10cc-b324-427e-8dd3-5c42afadf27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.962918] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed2d10cc-b324-427e-8dd3-5c42afadf27c: rpc.has_security_group_logging(os_id): False [ 849.981829] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.981829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.981829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.981829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.981829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.982139] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.982139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.982139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.982263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.982382] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.982614] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.982718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.982812] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.982970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.983058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.983255] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.983350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.983412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.983551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.983622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.983708] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c is going to be created. [ 850.044758] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.044895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.044962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.045192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.045456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.057102] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c in Status: IN_PROGRESS for 2s [ 850.891933] env[66854]: INFO networking_nsxv3.common.synchronization [req-cd2881ca-9698-4a20-bfdb-2f63a19c70b6 req-e8393ef2-4cab-4128-b3bd-12398ff87872 tempest-ListServerFiltersTestJSON-732493998 tempest-ListServerFiltersTestJSON-732493998-project-member] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 850.892616] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 850.893457] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.893457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.893457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.893457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.893457] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.893802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.893802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.893802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.893902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.893983] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.262473] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-914 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.263746] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.263746] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.263746] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.263746] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.263746] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.263746] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.263746] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.264223] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.264223] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.264223] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.264332] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.264474] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.264556] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.264655] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.264785] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.288344] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.288344] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.288344] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.288586] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.288801] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-6250aed9-e37e-4d7a-8ef9-55f54986190d taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.288974] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-6250aed9-e37e-4d7a-8ef9-55f54986190d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.289151] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-6250aed9-e37e-4d7a-8ef9-55f54986190d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.289555] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-6250aed9-e37e-4d7a-8ef9-55f54986190d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.289758] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6250aed9-e37e-4d7a-8ef9-55f54986190d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.379571] env[66854]: INFO networking_nsxv3.common.synchronization [None req-7dc622aa-740d-4cb0-a477-c0628ba5cd95 None None] Enqueued Resource ID: 48e54015-5e39-476c-b1e5-db4e980ed77a with Priority: HIGHEST for action port [ 851.380680] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e54015-5e39-476c-b1e5-db4e980ed77a with Priority: HIGHEST for action port [ 851.381026] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-48e54015-5e39-476c-b1e5-db4e980ed77a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.381170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48e54015-5e39-476c-b1e5-db4e980ed77a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.381240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48e54015-5e39-476c-b1e5-db4e980ed77a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.381553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48e54015-5e39-476c-b1e5-db4e980ed77a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.381625] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48e54015-5e39-476c-b1e5-db4e980ed77a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.396512] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.793088] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.793410] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.793520] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.793836] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.793992] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.794171] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 6250aed9-e37e-4d7a-8ef9-55f54986190d not found, creating... [ 851.794544] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.794727] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.794848] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.795910] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.795910] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.795910] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.795910] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.796132] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.796315] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.796457] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.796599] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 6250aed9-e37e-4d7a-8ef9-55f54986190d is going to be created. [ 851.821778] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.822050] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.822180] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.822413] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.822672] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.822910] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-6250aed9-e37e-4d7a-8ef9-55f54986190d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.886421] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48e54015-5e39-476c-b1e5-db4e980ed77a [ 851.886685] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.886828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.886898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.887332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.887332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.887332] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48e54015-5e39-476c-b1e5-db4e980ed77a already deleted. [ 851.887456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48e54015-5e39-476c-b1e5-db4e980ed77a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.899129] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.071654] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c in Status: SUCCESS [ 852.071948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.402195] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.402572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.402572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.402852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.403019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.403230] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be updated. [ 852.439920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.442788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.442788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.442788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.442788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.453292] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: IN_PROGRESS for 2s [ 852.553431] env[66854]: INFO networking_nsxv3.common.synchronization [req-cd2881ca-9698-4a20-bfdb-2f63a19c70b6 req-57a0da77-4409-49b0-980c-8f02134035ee service nova] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_rules [ 852.553612] env[66854]: INFO networking_nsxv3.common.synchronization [req-cd2881ca-9698-4a20-bfdb-2f63a19c70b6 req-57a0da77-4409-49b0-980c-8f02134035ee service nova] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 852.553755] env[66854]: INFO networking_nsxv3.common.synchronization [req-cd2881ca-9698-4a20-bfdb-2f63a19c70b6 req-57a0da77-4409-49b0-980c-8f02134035ee service nova] Enqueued Resource ID: 6250aed9-e37e-4d7a-8ef9-55f54986190d with Priority: HIGHEST for action port [ 852.554740] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_rules [ 852.554887] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 852.554987] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6250aed9-e37e-4d7a-8ef9-55f54986190d with Priority: HIGHEST for action port [ 852.555287] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.555407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.555517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.555704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.557025] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.558531] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.558642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.558853] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-6250aed9-e37e-4d7a-8ef9-55f54986190d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.558966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6250aed9-e37e-4d7a-8ef9-55f54986190d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.559023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6250aed9-e37e-4d7a-8ef9-55f54986190d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.559213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6250aed9-e37e-4d7a-8ef9-55f54986190d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.559294] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6250aed9-e37e-4d7a-8ef9-55f54986190d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.798423] env[66854]: INFO networking_nsxv3.common.synchronization [req-96ddbf35-7166-422e-a78a-4d4cd5600495 req-b8774f64-ef3f-42f9-9f7c-448007bf5586 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGHEST for action security_group_members [ 852.798423] env[66854]: INFO networking_nsxv3.common.synchronization [req-96ddbf35-7166-422e-a78a-4d4cd5600495 req-b8774f64-ef3f-42f9-9f7c-448007bf5586 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 852.798423] env[66854]: INFO networking_nsxv3.common.synchronization [req-96ddbf35-7166-422e-a78a-4d4cd5600495 req-b8774f64-ef3f-42f9-9f7c-448007bf5586 tempest-SecurityGroupsTestJSON-86873920 tempest-SecurityGroupsTestJSON-86873920-project-member] Enqueued Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_members [ 852.798889] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGHEST for action security_group_members [ 852.798999] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGHEST for action security_group_members [ 852.798999] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGHEST for action security_group_members [ 852.799418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.799551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.799634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.799908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.800300] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.800300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.800424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.800468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.800558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.800654] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.801912] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.802049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.802125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.802272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.802462] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.802582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.802632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.802822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.802912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.803028] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.804357] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.804466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.804593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.805056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.805056] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.805056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.805056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.805381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.805381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.805381] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.062215] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.062433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.062614] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6250aed9-e37e-4d7a-8ef9-55f54986190d with status ACTIVE [ 853.062879] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.062992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.063074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.063340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.063421] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.063668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.063841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.063949] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.064257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.064257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.064410] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.064519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.064519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.064663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.064735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.064808] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6250aed9-e37e-4d7a-8ef9-55f54986190d is going to be updated. [ 853.088787] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.088955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.089017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.089238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.089383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.089554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6250aed9-e37e-4d7a-8ef9-55f54986190d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.305375] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.305375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.305375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.305764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.305764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.305866] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.306274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.306274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.306274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.306274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.306450] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be updated. [ 853.307627] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.307745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.307812] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.307967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.308055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.308224] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.308320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.308381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.308522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.308596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.308680] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522304fc-ecb3-47d1-844c-54013760964c is going to be updated. [ 853.310095] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.310209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.310321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.310503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.310602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.310795] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.310894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.310985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.311114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.311190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.311271] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd is going to be updated. [ 853.379663] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.379891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.381622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.381622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.381622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.382686] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.382865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.382938] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.383164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.383781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.386031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.386031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.386031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.386246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.386285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.398037] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: IN_PROGRESS for 2s [ 853.398857] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd in Status: IN_PROGRESS for 2s [ 853.399525] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: IN_PROGRESS for 2s [ 853.630794] env[66854]: INFO networking_nsxv3.common.synchronization [req-d96af5c1-0606-4f13-8928-0d552dfaa4c1 req-83db6d69-dca1-4288-9da8-ee1da0acdf8d tempest-ListServerFiltersTestJSON-732493998 tempest-ListServerFiltersTestJSON-732493998-project-member] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 853.633721] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 853.633721] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.633721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.936024] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-914 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.936024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.936024] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.936499] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.936905] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.937271] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.942225] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.942225] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.942225] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.942225] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.942225] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.942225] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.942225] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.942225] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.942225] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.942225] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.965333] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.965333] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 853.965333] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.965333] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-914" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.965333] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-09072eb3-41a9-4d5d-98d3-22572c52af72 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.965637] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-09072eb3-41a9-4d5d-98d3-22572c52af72" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.965926] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-09072eb3-41a9-4d5d-98d3-22572c52af72" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.966499] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-09072eb3-41a9-4d5d-98d3-22572c52af72" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.966761] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09072eb3-41a9-4d5d-98d3-22572c52af72',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.464505] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 854.464827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.465236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.465236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.465411] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.465531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.465592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.465766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.465860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.465971] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.469141] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.470031] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.470031] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.470336] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.470470] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.470685] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 09072eb3-41a9-4d5d-98d3-22572c52af72 not found, creating... [ 854.470969] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.471138] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.471263] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.471460] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.471589] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.471869] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.472133] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.472292] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.472550] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.473452] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.473452] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 09072eb3-41a9-4d5d-98d3-22572c52af72 is going to be created. [ 854.494342] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.494856] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.494856] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.495080] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.495301] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.495528] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-09072eb3-41a9-4d5d-98d3-22572c52af72" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.969664] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.290983] env[66854]: INFO networking_nsxv3.common.synchronization [req-d96af5c1-0606-4f13-8928-0d552dfaa4c1 req-c02635df-4108-44fb-9c53-0ce0eb6e9c34 service nova] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_rules [ 855.291266] env[66854]: INFO networking_nsxv3.common.synchronization [req-d96af5c1-0606-4f13-8928-0d552dfaa4c1 req-c02635df-4108-44fb-9c53-0ce0eb6e9c34 service nova] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 855.291463] env[66854]: INFO networking_nsxv3.common.synchronization [req-d96af5c1-0606-4f13-8928-0d552dfaa4c1 req-c02635df-4108-44fb-9c53-0ce0eb6e9c34 service nova] Enqueued Resource ID: 09072eb3-41a9-4d5d-98d3-22572c52af72 with Priority: HIGHEST for action port [ 855.292388] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_rules [ 855.292675] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 855.292851] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09072eb3-41a9-4d5d-98d3-22572c52af72 with Priority: HIGHEST for action port [ 855.294059] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.294204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.294547] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.295383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.295383] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-09072eb3-41a9-4d5d-98d3-22572c52af72 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.295383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09072eb3-41a9-4d5d-98d3-22572c52af72" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.295383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09072eb3-41a9-4d5d-98d3-22572c52af72" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.295670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09072eb3-41a9-4d5d-98d3-22572c52af72" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.295670] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09072eb3-41a9-4d5d-98d3-22572c52af72',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.413435] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522304fc-ecb3-47d1-844c-54013760964c in Status: SUCCESS [ 855.413435] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522304fc-ecb3-47d1-844c-54013760964c deletion is rescheduled due to dependency. [ 855.413435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.413435] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd in Status: SUCCESS [ 855.413435] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd deletion is rescheduled due to dependency. [ 855.413435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.414250] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 in Status: SUCCESS [ 855.414529] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 deletion is rescheduled due to dependency. [ 855.414776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.473825] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.798339] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09072eb3-41a9-4d5d-98d3-22572c52af72 with status ACTIVE [ 855.798609] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.798698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.798772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.799014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.799110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.799327] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.799435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.799500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.799659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.799736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.799916] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.800058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.800092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.800312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.800389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.800477] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09072eb3-41a9-4d5d-98d3-22572c52af72 is going to be updated. [ 855.822592] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.822782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.822844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.823202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.823287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.823473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09072eb3-41a9-4d5d-98d3-22572c52af72" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.976792] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.977334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.977334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.977334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.977574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.977574] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be updated. [ 856.010707] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.010856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.010929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.011167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.011317] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.023085] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: IN_PROGRESS for 2s [ 856.827575] env[66854]: INFO networking_nsxv3.common.synchronization [req-b5c31f53-48f0-4be9-8f83-183c9a74bcbd req-496ffcd7-3c8e-4a94-9c40-3b5822f4df89 tempest-ServerAddressesNegativeTestJSON-1164281620 tempest-ServerAddressesNegativeTestJSON-1164281620-project-member] Enqueued Resource ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c with Priority: HIGHEST for action security_group_members [ 856.828150] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c with Priority: HIGHEST for action security_group_members [ 856.828466] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d10cc-b324-427e-8dd3-5c42afadf27c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.828592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.828734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.828921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.829096] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.829204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.829269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.829417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.829529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.829594] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2d10cc-b324-427e-8dd3-5c42afadf27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.334013] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.334378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.334378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.334569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.334651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.334792] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.334957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.335046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.335208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.335288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.335394] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c is going to be updated. [ 857.365653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.365969] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.366129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.366454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.366675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.375545] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c in Status: IN_PROGRESS for 2s [ 858.033979] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 858.034227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.034401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.034621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.034807] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.034941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.035069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.035237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.035319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.035409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.035548] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.036610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.036610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.036721] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.036820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.036873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.037029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.037198] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.037273] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.539783] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.540125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.540211] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.042411] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.386376] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c in Status: SUCCESS [ 859.386585] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c deletion is rescheduled due to dependency. [ 859.387208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.545212] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.545547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.545547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.545771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.545871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.545982] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be updated. [ 859.576161] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.576429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.576429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.576597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.576742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.586379] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: IN_PROGRESS for 2s [ 859.998202] env[66854]: INFO networking_nsxv3.common.synchronization [req-54a20676-787b-4b06-885d-ac7c35d385e8 req-45f8ef0b-f338-4f6f-b8c0-eed6fd3688ef tempest-ServersAdminNegativeTestJSON-44301001 tempest-ServersAdminNegativeTestJSON-44301001-project-member] Enqueued Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 859.998202] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGHEST for action security_group_members [ 859.998441] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.998506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.998544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.998734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.998890] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.998987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.999063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.999209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.999294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.999438] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.503470] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.503470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.503470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.503470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.522918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.522918] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.522918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.523157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.523191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.524127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.524127] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e is going to be updated. [ 860.552898] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.553351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.553565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.553862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.554069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.565599] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: IN_PROGRESS for 2s [ 861.604485] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 861.604727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.604884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.605140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.605402] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.605523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.605653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.605794] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.605875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.605975] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.109048] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.479768] env[66854]: INFO networking_nsxv3.common.synchronization [None req-2ccb52be-b058-4a1e-b7ef-5e93c442e052 tempest-ImagesOneServerNegativeTestJSON-1585579513 tempest-ImagesOneServerNegativeTestJSON-1585579513-project-member] Enqueued Resource ID: 91f556e7-5d3e-4cd6-9307-7af78194e5bb with Priority: HIGHEST for action security_group_rules [ 862.480311] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91f556e7-5d3e-4cd6-9307-7af78194e5bb with Priority: HIGHEST for action security_group_rules [ 862.480620] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91f556e7-5d3e-4cd6-9307-7af78194e5bb taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.480936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91f556e7-5d3e-4cd6-9307-7af78194e5bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.480936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91f556e7-5d3e-4cd6-9307-7af78194e5bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.481928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91f556e7-5d3e-4cd6-9307-7af78194e5bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.482045] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91f556e7-5d3e-4cd6-9307-7af78194e5bb',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.576326] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e in Status: SUCCESS [ 862.576582] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e deletion is rescheduled due to dependency. [ 862.579026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.611360] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.628844] env[66854]: INFO networking_nsxv3.common.synchronization [None req-2295b103-6b4c-4f8e-a404-c1ddf973afcb tempest-ImagesOneServerNegativeTestJSON-1585579513 tempest-ImagesOneServerNegativeTestJSON-1585579513-project-member] Enqueued Resource ID: 91f556e7-5d3e-4cd6-9307-7af78194e5bb with Priority: HIGHEST for action security_group_rules [ 862.628844] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91f556e7-5d3e-4cd6-9307-7af78194e5bb with Priority: HIGHEST for action security_group_rules [ 862.629659] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91f556e7-5d3e-4cd6-9307-7af78194e5bb taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.629790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91f556e7-5d3e-4cd6-9307-7af78194e5bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.015972] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.016166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.016212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.016545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.016637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.016738] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91f556e7-5d3e-4cd6-9307-7af78194e5bb already deleted. [ 863.016824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91f556e7-5d3e-4cd6-9307-7af78194e5bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.017042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91f556e7-5d3e-4cd6-9307-7af78194e5bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.017193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91f556e7-5d3e-4cd6-9307-7af78194e5bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.017280] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91f556e7-5d3e-4cd6-9307-7af78194e5bb',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.115287] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.115493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.115608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.115836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.115947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.116109] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be updated. [ 863.151041] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.151041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.151478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.151478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.151478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.162664] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: IN_PROGRESS for 2s [ 863.544413] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.544413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.544413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.544413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.544413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.544413] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91f556e7-5d3e-4cd6-9307-7af78194e5bb already deleted. [ 863.544413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91f556e7-5d3e-4cd6-9307-7af78194e5bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.728028] env[66854]: INFO networking_nsxv3.common.synchronization [None req-13ea9612-25d0-4193-b8a9-86fcb0c8a6d2 None None] Enqueued Resource ID: e76e512b-7bf5-448f-93d9-db1b1751d1f5 with Priority: HIGHEST for action port [ 863.728573] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e76e512b-7bf5-448f-93d9-db1b1751d1f5 with Priority: HIGHEST for action port [ 863.728573] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e76e512b-7bf5-448f-93d9-db1b1751d1f5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.728683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e76e512b-7bf5-448f-93d9-db1b1751d1f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.728766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e76e512b-7bf5-448f-93d9-db1b1751d1f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.729070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e76e512b-7bf5-448f-93d9-db1b1751d1f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.729189] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e76e512b-7bf5-448f-93d9-db1b1751d1f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.231532] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e76e512b-7bf5-448f-93d9-db1b1751d1f5 [ 864.231759] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.232124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.232124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.232230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.232362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.232509] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e76e512b-7bf5-448f-93d9-db1b1751d1f5 already deleted. [ 864.232580] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e76e512b-7bf5-448f-93d9-db1b1751d1f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.175590] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 865.175916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.175963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.176213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.176391] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.176634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.176634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.176793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.176840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.176932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.177219] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.177219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.177833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.177833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.177833] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.177833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.177833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.182338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.182338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.182338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.182338] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.685360] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1466949f-e84c-4398-88b8-456cc5ec401b: rpc.has_security_group_logging(os_id): False [ 865.728764] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.729677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.729801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.730074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.730544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.730872] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.731079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.731183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.731444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.731737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.731970] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.735156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.735232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.735392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.735471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.735726] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.735833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.735897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.736061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.736141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.736227] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be updated. [ 865.800195] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.800376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.800440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.800690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.800859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.816875] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: IN_PROGRESS for 2s [ 866.376627] env[66854]: INFO networking_nsxv3.common.synchronization [None req-8d741bf0-5567-4257-b863-fc7ba10ad046 None None] Enqueued Resource ID: 188b8d2c-1c0c-4016-ad32-09c1bb0de626 with Priority: HIGHEST for action port [ 866.377265] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 188b8d2c-1c0c-4016-ad32-09c1bb0de626 with Priority: HIGHEST for action port [ 866.377583] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-188b8d2c-1c0c-4016-ad32-09c1bb0de626 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.377704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-188b8d2c-1c0c-4016-ad32-09c1bb0de626" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.377834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-188b8d2c-1c0c-4016-ad32-09c1bb0de626" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.378103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-188b8d2c-1c0c-4016-ad32-09c1bb0de626" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.378103] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('188b8d2c-1c0c-4016-ad32-09c1bb0de626',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.883333] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 188b8d2c-1c0c-4016-ad32-09c1bb0de626 [ 866.883333] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.883333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.883333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.883333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.883333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.883333] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:188b8d2c-1c0c-4016-ad32-09c1bb0de626 already deleted. [ 866.883333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-188b8d2c-1c0c-4016-ad32-09c1bb0de626" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.174129] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb1786e1-97ef-41e7-87a6-057565cea9ca req-0d53b3d0-1da5-416e-9841-ebf17bcab37f tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 867.174733] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 867.176129] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.176342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.176434] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.176735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.176930] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.177089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.177198] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.177394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.177507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.177635] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.539126] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-768 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.539453] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-768" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.539453] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-768" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.539782] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-768" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.540063] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.540221] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.540335] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.540543] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.540678] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.540887] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.540998] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.541217] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.541349] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.541515] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.541635] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.542120] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.564876] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.565242] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 867.565492] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.565739] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-768" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.566176] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.566354] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.566474] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.566829] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.567101] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffe1e47e-cc58-43c3-bf93-e4cad5cba830',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.681091] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.681091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.681373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.681373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.681494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.681655] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.681756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.681819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.681991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.682177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.682177] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a already deleted. [ 867.682250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.831234] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 867.831398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.831585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.831838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.831940] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.069723] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.070167] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.070167] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.070365] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.070468] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.070614] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port ffe1e47e-cc58-43c3-bf93-e4cad5cba830 not found, creating... [ 868.070871] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.071068] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.071187] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.071400] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.071533] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.071810] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.071958] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.072089] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.072294] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.072422] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.072760] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: ffe1e47e-cc58-43c3-bf93-e4cad5cba830 is going to be created. [ 868.097758] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.098119] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.098221] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.099309] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.099309] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.099309] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.256148] env[66854]: INFO networking_nsxv3.common.synchronization [None req-43f236e0-b4d4-4808-8162-da4b73519731 None None] Enqueued Resource ID: fca6bafc-a740-4471-b956-3e09c8e16e83 with Priority: HIGHEST for action port [ 868.256798] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca6bafc-a740-4471-b956-3e09c8e16e83 with Priority: HIGHEST for action port [ 868.257208] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-fca6bafc-a740-4471-b956-3e09c8e16e83 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.257344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fca6bafc-a740-4471-b956-3e09c8e16e83" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.257415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fca6bafc-a740-4471-b956-3e09c8e16e83" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.257701] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fca6bafc-a740-4471-b956-3e09c8e16e83" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.257794] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fca6bafc-a740-4471-b956-3e09c8e16e83',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.335198] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.335436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.335541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.335901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.336107] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.336223] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.336301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.336483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.336619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.337418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.337418] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.759771] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fca6bafc-a740-4471-b956-3e09c8e16e83 [ 868.760110] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.760271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.760354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.760611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.760724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.760797] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fca6bafc-a740-4471-b956-3e09c8e16e83 already deleted. [ 868.760881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fca6bafc-a740-4471-b956-3e09c8e16e83" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.822092] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb1786e1-97ef-41e7-87a6-057565cea9ca req-cd1e478f-ae9d-4a9e-b343-906527a8e49f service nova] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_rules [ 868.822458] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb1786e1-97ef-41e7-87a6-057565cea9ca req-cd1e478f-ae9d-4a9e-b343-906527a8e49f service nova] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 868.822669] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb1786e1-97ef-41e7-87a6-057565cea9ca req-cd1e478f-ae9d-4a9e-b343-906527a8e49f service nova] Enqueued Resource ID: ffe1e47e-cc58-43c3-bf93-e4cad5cba830 with Priority: HIGHEST for action port [ 868.823968] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_rules [ 868.823968] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 868.823968] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe1e47e-cc58-43c3-bf93-e4cad5cba830 with Priority: HIGHEST for action port [ 868.823968] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.823968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.824462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.824462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.824462] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.825385] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.825518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.825563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.825770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.825953] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.826060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.826124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.826259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.826337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.826424] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.827212] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.827314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.827503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.828090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.828090] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffe1e47e-cc58-43c3-bf93-e4cad5cba830',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.839070] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.841030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.841030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.841030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.841030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.844138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.844138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.844138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.844138] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.332891] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.335661] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.335661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.335661] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffe1e47e-cc58-43c3-bf93-e4cad5cba830 with status ACTIVE [ 869.335661] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.335661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.335661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.335661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.336179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.336179] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.336618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.336618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.337781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.337781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.337781] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.337781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.337781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.337781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.337781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.337781] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffe1e47e-cc58-43c3-bf93-e4cad5cba830 is going to be updated. [ 869.346093] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1466949f-e84c-4398-88b8-456cc5ec401b: rpc.has_security_group_logging(os_id): False [ 869.364644] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.364842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.364919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.365148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.365293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.365458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.367418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.368271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.368271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.368271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.368271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.368271] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.368271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.368271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.368587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.368587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.368658] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.368767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.368817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.369404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.369404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.369404] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.369404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.369606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.369654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.369734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.369822] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be updated. [ 869.447829] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.447829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.447829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.447829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.448151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.480278] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: IN_PROGRESS for 2s [ 869.796492] env[66854]: INFO networking_nsxv3.common.synchronization [req-fc455b63-edef-46da-a2d6-64eff9cdec64 req-87acda90-3df8-48bd-aaa8-2e43e0cb44a3 tempest-ServersNegativeTestMultiTenantJSON-1858190103 tempest-ServersNegativeTestMultiTenantJSON-1858190103-project-member] Enqueued Resource ID: 71d1134e-4384-4c31-836b-3726375f2c2c with Priority: HIGHEST for action security_group_members [ 869.796931] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d1134e-4384-4c31-836b-3726375f2c2c with Priority: HIGHEST for action security_group_members [ 869.797397] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-71d1134e-4384-4c31-836b-3726375f2c2c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.797397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.797757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.798049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.798230] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.798332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.798397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.798568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.800217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.800217] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71d1134e-4384-4c31-836b-3726375f2c2c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.839349] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.218563] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.218845] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-839" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.218887] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-839" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.219736] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-839" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.220075] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.220235] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.220326] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.220558] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.220703] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.221842] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.222027] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.222160] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.223221] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.223361] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.223844] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.223844] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.246441] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.246626] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 870.246766] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.246948] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-839" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.247291] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-0087d7f0-502d-471b-8eae-62beaae8664f taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.247464] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-0087d7f0-502d-471b-8eae-62beaae8664f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.247597] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-0087d7f0-502d-471b-8eae-62beaae8664f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.247919] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-0087d7f0-502d-471b-8eae-62beaae8664f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.248085] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0087d7f0-502d-471b-8eae-62beaae8664f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.301503] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.301787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.301987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.302253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.302360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.302575] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.302680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.302737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.302902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.302986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.303089] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71d1134e-4384-4c31-836b-3726375f2c2c already deleted. [ 870.303171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.342559] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.342769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.342769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.342996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.343335] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.343335] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a is going to be created. [ 870.372943] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.373092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.373644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.373644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.374394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.389234] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: UNINITIALIZED for 2s [ 870.750525] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.750938] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.751134] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.751477] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.751675] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.751979] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 0087d7f0-502d-471b-8eae-62beaae8664f not found, creating... [ 870.752183] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.752351] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.752500] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.752822] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.753021] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.753354] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.753581] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.753796] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.754216] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.754436] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.754614] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 0087d7f0-502d-471b-8eae-62beaae8664f is going to be created. [ 870.770553] env[66854]: INFO networking_nsxv3.common.synchronization [None req-caf4b7c6-87f5-4074-89a6-829efbcab6d3 None None] Enqueued Resource ID: 8a595299-2ed8-4913-9bdf-abd99d9663de with Priority: HIGHEST for action port [ 870.771098] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a595299-2ed8-4913-9bdf-abd99d9663de with Priority: HIGHEST for action port [ 870.773766] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a595299-2ed8-4913-9bdf-abd99d9663de taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.773766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a595299-2ed8-4913-9bdf-abd99d9663de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.773766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a595299-2ed8-4913-9bdf-abd99d9663de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.774990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a595299-2ed8-4913-9bdf-abd99d9663de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.774990] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a595299-2ed8-4913-9bdf-abd99d9663de',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.776096] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.776311] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.776432] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.776698] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.776972] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.781333] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-0087d7f0-502d-471b-8eae-62beaae8664f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.282692] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a595299-2ed8-4913-9bdf-abd99d9663de [ 871.283112] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.283967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.283967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.283967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.283967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.283967] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a595299-2ed8-4913-9bdf-abd99d9663de already deleted. [ 871.283967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a595299-2ed8-4913-9bdf-abd99d9663de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.497539] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 871.497539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.611297] env[66854]: INFO networking_nsxv3.common.synchronization [req-fc455b63-edef-46da-a2d6-64eff9cdec64 req-8affd888-c1db-41dd-be36-65d7242d0135 service nova] Enqueued Resource ID: 71d1134e-4384-4c31-836b-3726375f2c2c with Priority: HIGHEST for action security_group_rules [ 871.611297] env[66854]: INFO networking_nsxv3.common.synchronization [req-fc455b63-edef-46da-a2d6-64eff9cdec64 req-8affd888-c1db-41dd-be36-65d7242d0135 service nova] Enqueued Resource ID: 71d1134e-4384-4c31-836b-3726375f2c2c with Priority: HIGHEST for action security_group_members [ 871.611797] env[66854]: INFO networking_nsxv3.common.synchronization [req-fc455b63-edef-46da-a2d6-64eff9cdec64 req-8affd888-c1db-41dd-be36-65d7242d0135 service nova] Enqueued Resource ID: 0087d7f0-502d-471b-8eae-62beaae8664f with Priority: HIGHEST for action port [ 871.612888] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d1134e-4384-4c31-836b-3726375f2c2c with Priority: HIGHEST for action security_group_rules [ 871.613834] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d1134e-4384-4c31-836b-3726375f2c2c with Priority: HIGHEST for action security_group_members [ 871.613834] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0087d7f0-502d-471b-8eae-62beaae8664f with Priority: HIGHEST for action port [ 871.613834] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71d1134e-4384-4c31-836b-3726375f2c2c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.613834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.613834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.614247] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.614247] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71d1134e-4384-4c31-836b-3726375f2c2c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.616735] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-71d1134e-4384-4c31-836b-3726375f2c2c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.616735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.616735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.616735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.616735] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.616735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.616735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.616735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.616735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.616735] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71d1134e-4384-4c31-836b-3726375f2c2c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.617745] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-0087d7f0-502d-471b-8eae-62beaae8664f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.617745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0087d7f0-502d-471b-8eae-62beaae8664f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.617745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0087d7f0-502d-471b-8eae-62beaae8664f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.617745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0087d7f0-502d-471b-8eae-62beaae8664f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.617745] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0087d7f0-502d-471b-8eae-62beaae8664f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.120015] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-71d1134e-4384-4c31-836b-3726375f2c2c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.120188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.120407] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71d1134e-4384-4c31-836b-3726375f2c2c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.121457] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0087d7f0-502d-471b-8eae-62beaae8664f with status ACTIVE [ 872.121736] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.121853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.121942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.122202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.122316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.122496] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.122602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.122664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.122847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.122928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.125052] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.125207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.125207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.125387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.125452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.125558] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0087d7f0-502d-471b-8eae-62beaae8664f is going to be updated. [ 872.151162] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.151343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.151408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.151593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.151732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.152381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0087d7f0-502d-471b-8eae-62beaae8664f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.399621] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: SUCCESS [ 872.399905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.401523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.401523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.401523] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.401523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.401523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.401523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.401523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.401523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.401523] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.628682] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71d1134e-4384-4c31-836b-3726375f2c2c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.903697] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.131147] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.131407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.131493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.131812] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.131947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.132138] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71d1134e-4384-4c31-836b-3726375f2c2c is going to be created. [ 873.166925] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.167199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.167199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.167447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.167737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.181866] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71d1134e-4384-4c31-836b-3726375f2c2c in Status: UNINITIALIZED for 2s [ 873.406317] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12f42aff-e1af-41a3-a87d-1db3a0580e1a: rpc.has_security_group_logging(os_id): False [ 873.431041] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.431041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.431041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.431365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.431503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.431881] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.432100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.432241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.432496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.432740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.432802] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a is going to be created. [ 873.501903] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.502059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.502159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.502370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.502553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.515173] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: IN_PROGRESS for 2s [ 875.192373] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71d1134e-4384-4c31-836b-3726375f2c2c in Status: SUCCESS [ 875.192685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.192834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.193065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.193273] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.193710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.193710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.193710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.193710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.193904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.193904] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71d1134e-4384-4c31-836b-3726375f2c2c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.532235] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: SUCCESS [ 875.532459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.696275] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-71d1134e-4384-4c31-836b-3726375f2c2c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.696481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.696659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.696755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.696947] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.697232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.697232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.697407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.697407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.697491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.697576] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-71d1134e-4384-4c31-836b-3726375f2c2c taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.697669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.697730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.697871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.698022] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.698116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.698176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.698446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.698446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.698446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.698641] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71d1134e-4384-4c31-836b-3726375f2c2c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.201490] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71d1134e-4384-4c31-836b-3726375f2c2c: rpc.has_security_group_logging(os_id): False [ 876.224065] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.224273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.224480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.224844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.225238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.225335] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.225518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.225656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.225891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.225992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.226237] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.226552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.226636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.226844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.226950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.227199] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.227643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.227705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.227916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.228162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.228216] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71d1134e-4384-4c31-836b-3726375f2c2c is going to be created. [ 876.307060] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.307060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.307060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.307060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.307060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.323259] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71d1134e-4384-4c31-836b-3726375f2c2c in Status: IN_PROGRESS for 2s [ 876.614500] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 876.614611] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 878.339357] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71d1134e-4384-4c31-836b-3726375f2c2c in Status: SUCCESS [ 878.339654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.056308] env[66854]: INFO networking_nsxv3.common.synchronization [req-8b057245-8639-45d7-a230-de5fbd622d70 req-a6e0440b-9cf5-44b3-b550-2ddb451b7e69 tempest-ListServerFiltersTestJSON-732493998 tempest-ListServerFiltersTestJSON-732493998-project-member] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 880.056308] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 880.056308] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.056308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.056308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.056973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.056973] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.056973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.056973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.057149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.057149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.057219] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.561192] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.063691] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.567891] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.568114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.568185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.568417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.568511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.568618] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be updated. [ 881.600869] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.601072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.601120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.601315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.601464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.614364] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: IN_PROGRESS for 2s [ 882.974653] env[66854]: INFO networking_nsxv3.common.synchronization [req-dee60a4c-1a5b-44f5-afcd-3d19da8c0748 req-af111490-4bdd-4cad-8b28-370f56734732 tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 882.975418] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 882.975864] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.976066] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.976188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.976542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.976781] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.976946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.977084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.977317] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.977410] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.977532] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.017797] env[66854]: INFO networking_nsxv3.common.synchronization [req-b9a28207-0745-46c5-ac4a-d815c5b30948 req-8430b263-61dc-445b-8630-5b0911bc0580 tempest-ServersNegativeTestMultiTenantJSON-1858190103 tempest-ServersNegativeTestMultiTenantJSON-1858190103-project-member] Enqueued Resource ID: 71d1134e-4384-4c31-836b-3726375f2c2c with Priority: HIGHEST for action security_group_members [ 883.018316] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d1134e-4384-4c31-836b-3726375f2c2c with Priority: HIGHEST for action security_group_members [ 883.019311] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-71d1134e-4384-4c31-836b-3726375f2c2c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.019311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.019311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.019311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.019840] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.020059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.020131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.020322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.020431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.020675] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71d1134e-4384-4c31-836b-3726375f2c2c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.357224] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.357428] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.357563] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.357955] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.358254] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.358417] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.358532] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.358746] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.358884] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.359121] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.359259] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.359360] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.359465] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.359572] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.359676] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.359804] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.381732] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.383088] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.383088] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.383088] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.383088] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-49d12635-95b0-4403-8a40-f80a8f150d3d taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.383088] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-49d12635-95b0-4403-8a40-f80a8f150d3d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.383088] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-49d12635-95b0-4403-8a40-f80a8f150d3d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.383704] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-49d12635-95b0-4403-8a40-f80a8f150d3d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.384145] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49d12635-95b0-4403-8a40-f80a8f150d3d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.480381] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.480544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.480616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.480830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.480936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.481164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.481281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.481351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.481518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.481597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.481683] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa already deleted. [ 883.481762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.522656] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.522801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.523164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.523164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.523282] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.523450] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.523540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.523581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.523698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.523788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.523851] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71d1134e-4384-4c31-836b-3726375f2c2c is going to be updated. [ 883.553048] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.553048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.553048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.553264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.553324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.567421] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71d1134e-4384-4c31-836b-3726375f2c2c in Status: IN_PROGRESS for 2s [ 883.624115] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 883.624381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.887576] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.887781] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.888125] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.888178] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.888332] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.888485] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 49d12635-95b0-4403-8a40-f80a8f150d3d not found, creating... [ 883.888738] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.888892] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.889020] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.889248] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.889393] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.889688] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.889856] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.889968] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.890210] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.890328] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.890463] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 49d12635-95b0-4403-8a40-f80a8f150d3d is going to be created. [ 883.911935] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.912211] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.912256] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.912565] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.912932] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.913020] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-49d12635-95b0-4403-8a40-f80a8f150d3d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.645712] env[66854]: INFO networking_nsxv3.common.synchronization [req-dee60a4c-1a5b-44f5-afcd-3d19da8c0748 req-39b15a8d-9ae4-4be2-a768-9a5e55f9b4a2 service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 884.647978] env[66854]: INFO networking_nsxv3.common.synchronization [req-dee60a4c-1a5b-44f5-afcd-3d19da8c0748 req-39b15a8d-9ae4-4be2-a768-9a5e55f9b4a2 service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 884.648269] env[66854]: INFO networking_nsxv3.common.synchronization [req-dee60a4c-1a5b-44f5-afcd-3d19da8c0748 req-39b15a8d-9ae4-4be2-a768-9a5e55f9b4a2 service nova] Enqueued Resource ID: 49d12635-95b0-4403-8a40-f80a8f150d3d with Priority: HIGHEST for action port [ 884.648927] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 884.649087] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 884.649189] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d12635-95b0-4403-8a40-f80a8f150d3d with Priority: HIGHEST for action port [ 884.649484] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.649605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.649677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.649953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.650055] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.651468] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.651599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.651668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.651851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.652040] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.652117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.652195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.652404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.652488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.652547] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.653379] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-49d12635-95b0-4403-8a40-f80a8f150d3d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.653523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49d12635-95b0-4403-8a40-f80a8f150d3d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.653573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49d12635-95b0-4403-8a40-f80a8f150d3d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.653714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49d12635-95b0-4403-8a40-f80a8f150d3d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.653778] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49d12635-95b0-4403-8a40-f80a8f150d3d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.152055] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.152271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.155642] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49d12635-95b0-4403-8a40-f80a8f150d3d with status ACTIVE [ 885.155873] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.156033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.156117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.156377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.156490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.156698] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.156810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.156876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.157077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.157197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.157400] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.157514] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.157585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.157739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.157831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.157919] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49d12635-95b0-4403-8a40-f80a8f150d3d is going to be updated. [ 885.159155] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.186550] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.186754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.186754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.186964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.187116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.187304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49d12635-95b0-4403-8a40-f80a8f150d3d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.577835] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71d1134e-4384-4c31-836b-3726375f2c2c in Status: SUCCESS [ 885.578052] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71d1134e-4384-4c31-836b-3726375f2c2c deletion is rescheduled due to dependency. [ 885.578132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.661339] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.728664] env[66854]: INFO networking_nsxv3.common.synchronization [req-d44d4d46-d311-4042-9f20-75cd94d78857 req-d58e4c72-73ef-4dd1-ac1d-45d639a750c3 tempest-ServerActionsV293TestJSON-908997761 tempest-ServerActionsV293TestJSON-908997761-project-member] Enqueued Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_members [ 885.729208] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_members [ 885.729568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c2a68c-9d14-4fc3-b48e-002677e41a31 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.729705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.729774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.730103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.730302] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.730434] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.730520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.730713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.730829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.730952] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.071747] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-495 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.071959] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-495" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.072100] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-495" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.072541] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-495" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.072823] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.072983] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.073146] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.073378] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.073682] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.073888] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.074009] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.074126] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.074233] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.074344] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.074448] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.074658] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.097680] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.098816] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.098816] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.098816] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-495" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.098816] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-2119bc44-e5b5-494b-b45c-62d586343662 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.099176] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-2119bc44-e5b5-494b-b45c-62d586343662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.099176] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-2119bc44-e5b5-494b-b45c-62d586343662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.099503] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-2119bc44-e5b5-494b-b45c-62d586343662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.099661] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2119bc44-e5b5-494b-b45c-62d586343662',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.164190] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.164190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.164412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.164521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.164660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.164762] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be created. [ 886.195082] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.195483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.195483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.195702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.195875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.209413] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: UNINITIALIZED for 2s [ 886.233606] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.233791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.233864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.234101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.234189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.234399] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.234503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.234565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.234719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.234793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.234975] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 already deleted. [ 886.235073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.606240] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.606586] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.606990] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.607310] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.607603] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.607852] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 2119bc44-e5b5-494b-b45c-62d586343662 not found, creating... [ 886.608339] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.608613] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.608824] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.613943] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.614128] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.614918] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.615202] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.615202] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.615482] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.615644] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.615820] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 2119bc44-e5b5-494b-b45c-62d586343662 is going to be created. [ 886.643492] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.643725] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.643861] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.644163] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.644437] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.644684] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-2119bc44-e5b5-494b-b45c-62d586343662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.358299] env[66854]: INFO networking_nsxv3.common.synchronization [req-d44d4d46-d311-4042-9f20-75cd94d78857 req-4a325dd9-986e-4198-bf4e-499493051432 service nova] Enqueued Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_rules [ 887.358299] env[66854]: INFO networking_nsxv3.common.synchronization [req-d44d4d46-d311-4042-9f20-75cd94d78857 req-4a325dd9-986e-4198-bf4e-499493051432 service nova] Enqueued Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_members [ 887.358299] env[66854]: INFO networking_nsxv3.common.synchronization [req-d44d4d46-d311-4042-9f20-75cd94d78857 req-4a325dd9-986e-4198-bf4e-499493051432 service nova] Enqueued Resource ID: 2119bc44-e5b5-494b-b45c-62d586343662 with Priority: HIGHEST for action port [ 887.358708] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_rules [ 887.358708] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_members [ 887.358708] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2119bc44-e5b5-494b-b45c-62d586343662 with Priority: HIGHEST for action port [ 887.358931] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.359115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.359115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.359315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.359393] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.361048] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c2a68c-9d14-4fc3-b48e-002677e41a31 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.361048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.361048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.361048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.361048] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.361420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.361420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.361420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.361420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.361714] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.362898] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-2119bc44-e5b5-494b-b45c-62d586343662 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.362898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2119bc44-e5b5-494b-b45c-62d586343662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.362898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2119bc44-e5b5-494b-b45c-62d586343662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.363124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2119bc44-e5b5-494b-b45c-62d586343662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.363124] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2119bc44-e5b5-494b-b45c-62d586343662',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.865624] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c2a68c-9d14-4fc3-b48e-002677e41a31 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.865714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.865902] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.867075] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2119bc44-e5b5-494b-b45c-62d586343662 with status ACTIVE [ 887.867439] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.867608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.867681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.868092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.868092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.868215] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.868271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.868457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.868528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.868564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.868853] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.868853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.868968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.870243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.870243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.870243] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2119bc44-e5b5-494b-b45c-62d586343662 is going to be updated. [ 887.895418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.895627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.895672] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.895891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.896048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.896224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2119bc44-e5b5-494b-b45c-62d586343662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.220266] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 888.220718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.220993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.221320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.221602] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.221965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.222175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.222684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.222877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.223495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.223765] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.371840] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.727158] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.727369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.727454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.727725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.727904] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.728028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.728092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.728271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.728360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.728472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.728729] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.728829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.728895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.729059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.729512] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.729621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.729685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.729837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.729915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.730831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.731483] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.878929] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.878929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.878929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.879102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.879221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.879447] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 is going to be created. [ 888.924386] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.924539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.924678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.927332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.927578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.947315] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 in Status: UNINITIALIZED for 2s [ 889.236372] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab5dfec-4c69-486f-983d-2ea9413eccfa: rpc.has_security_group_logging(os_id): False [ 889.321443] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.321639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.324139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.324139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.324139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.324139] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.324139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.324139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.324547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.324547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.324733] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.324888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.325512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.325512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.325512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.325719] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.325879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.325996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.326259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.326400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.326574] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be created. [ 889.455793] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.456115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.456115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.456236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.456441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.479416] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 890.958933] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 in Status: SUCCESS [ 890.959322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.959322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.959815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.959815] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.960023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.960023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.960128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.960230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.960413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.960413] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.440791] env[66854]: INFO networking_nsxv3.common.synchronization [req-329aa9b2-17f9-4484-9ad3-eca43677ff49 req-46aa881f-7a19-4d40-8e51-9591c5af0b46 tempest-ServerAddressesTestJSON-779304346 tempest-ServerAddressesTestJSON-779304346-project-member] Enqueued Resource ID: f972a36b-9b6b-4a54-abd1-328458bb94ea with Priority: HIGHEST for action security_group_members [ 891.441403] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f972a36b-9b6b-4a54-abd1-328458bb94ea with Priority: HIGHEST for action security_group_members [ 891.441717] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f972a36b-9b6b-4a54-abd1-328458bb94ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.441839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.441904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.442238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.442406] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.442508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.442573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.442723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.442825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.442924] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f972a36b-9b6b-4a54-abd1-328458bb94ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.462924] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.495647] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 891.496555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.763384] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-918 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.763484] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-918" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.763545] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-918" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.763952] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-918" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.764196] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.764338] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.764465] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.764677] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.764819] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.765057] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.765158] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.765266] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.765380] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.765479] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.765579] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.765948] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.785272] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.785417] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 891.785596] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.785894] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-918" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.786194] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-6f3324dd-c8af-4e2c-bedd-7316608f3f89 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.786373] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-6f3324dd-c8af-4e2c-bedd-7316608f3f89" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.786520] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-6f3324dd-c8af-4e2c-bedd-7316608f3f89" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.786922] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-6f3324dd-c8af-4e2c-bedd-7316608f3f89" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.787079] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f3324dd-c8af-4e2c-bedd-7316608f3f89',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.946070] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.946070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.946070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.946322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.946322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.946461] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.946519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.946575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.946745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.946826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.946918] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f972a36b-9b6b-4a54-abd1-328458bb94ea already deleted. [ 891.947051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.965197] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7c2a68c-9d14-4fc3-b48e-002677e41a31: rpc.has_security_group_logging(os_id): False [ 891.998935] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.999181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.999247] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.999421] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.999496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.999848] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.000021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.000095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.000330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.000459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.000598] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 is going to be created. [ 892.132556] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.132724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.132827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.133060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.133241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.159543] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 in Status: IN_PROGRESS for 2s [ 892.289605] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.289907] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.290097] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.290415] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.290578] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.290809] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 6f3324dd-c8af-4e2c-bedd-7316608f3f89 not found, creating... [ 892.291166] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.291410] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.291605] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.292144] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.292362] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.293178] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.293432] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.293557] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.293876] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.294179] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.294257] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 6f3324dd-c8af-4e2c-bedd-7316608f3f89 is going to be created. [ 892.325503] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.325754] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.325882] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.326182] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.326412] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.326657] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-6f3324dd-c8af-4e2c-bedd-7316608f3f89" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.082395] env[66854]: INFO networking_nsxv3.common.synchronization [req-329aa9b2-17f9-4484-9ad3-eca43677ff49 req-78a45e62-6b6c-4d75-9fd3-7c998f0ddd3e service nova] Enqueued Resource ID: f972a36b-9b6b-4a54-abd1-328458bb94ea with Priority: HIGHEST for action security_group_rules [ 893.082696] env[66854]: INFO networking_nsxv3.common.synchronization [req-329aa9b2-17f9-4484-9ad3-eca43677ff49 req-78a45e62-6b6c-4d75-9fd3-7c998f0ddd3e service nova] Enqueued Resource ID: f972a36b-9b6b-4a54-abd1-328458bb94ea with Priority: HIGHEST for action security_group_members [ 893.082724] env[66854]: INFO networking_nsxv3.common.synchronization [req-329aa9b2-17f9-4484-9ad3-eca43677ff49 req-78a45e62-6b6c-4d75-9fd3-7c998f0ddd3e service nova] Enqueued Resource ID: 6f3324dd-c8af-4e2c-bedd-7316608f3f89 with Priority: HIGHEST for action port [ 893.083442] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f972a36b-9b6b-4a54-abd1-328458bb94ea with Priority: HIGHEST for action security_group_rules [ 893.083490] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f972a36b-9b6b-4a54-abd1-328458bb94ea with Priority: HIGHEST for action security_group_members [ 893.083715] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f3324dd-c8af-4e2c-bedd-7316608f3f89 with Priority: HIGHEST for action port [ 893.083880] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f972a36b-9b6b-4a54-abd1-328458bb94ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.084049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.084094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.084343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.084430] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f972a36b-9b6b-4a54-abd1-328458bb94ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.087451] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f972a36b-9b6b-4a54-abd1-328458bb94ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.087521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.087591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.087866] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.087996] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.088150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.088243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.088354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.088441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.088546] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f972a36b-9b6b-4a54-abd1-328458bb94ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.089478] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f3324dd-c8af-4e2c-bedd-7316608f3f89 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.089578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f3324dd-c8af-4e2c-bedd-7316608f3f89" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.089647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f3324dd-c8af-4e2c-bedd-7316608f3f89" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.089803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f3324dd-c8af-4e2c-bedd-7316608f3f89" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.089885] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f3324dd-c8af-4e2c-bedd-7316608f3f89',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.592207] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f972a36b-9b6b-4a54-abd1-328458bb94ea taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.592347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.592789] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f972a36b-9b6b-4a54-abd1-328458bb94ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.594255] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f3324dd-c8af-4e2c-bedd-7316608f3f89 with status ACTIVE [ 893.594255] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.594255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.594255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.594255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.594255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.594255] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.594821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.594821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.594821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.594821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.594821] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.594961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.594987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.595153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.595226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.595310] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f3324dd-c8af-4e2c-bedd-7316608f3f89 is going to be updated. [ 893.620961] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.620961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.620961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.621145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.621145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.621306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f3324dd-c8af-4e2c-bedd-7316608f3f89" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.098056] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f972a36b-9b6b-4a54-abd1-328458bb94ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.171958] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 in Status: SUCCESS [ 894.172257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.601053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.601053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.601053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.601053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.601053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.601053] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f972a36b-9b6b-4a54-abd1-328458bb94ea is going to be created. [ 894.627936] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.628188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.628277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.628512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.628685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.641258] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f972a36b-9b6b-4a54-abd1-328458bb94ea in Status: UNINITIALIZED for 2s [ 895.164799] env[66854]: INFO networking_nsxv3.common.synchronization [req-60c30d31-efbe-42c2-9405-c3835a8b8c72 req-9a283c4e-38d3-46a7-b056-b462074bbfd7 tempest-ServerRescueNegativeTestJSON-1659784790 tempest-ServerRescueNegativeTestJSON-1659784790-project-member] Enqueued Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_members [ 895.165136] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_members [ 895.165478] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-789c0fa6-0949-4f7b-a35b-21a28f7a5386 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.166100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.166100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.166100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.166271] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.166325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.166407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.166599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.166698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.166820] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.585897] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-406 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.586532] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.586790] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.587487] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.587937] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.588118] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.588307] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.588606] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.589645] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.589645] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.589645] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.589645] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.589645] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.589645] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.589645] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.589943] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.633104] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.633326] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.633474] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.633654] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-406" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.634041] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-99f32904-f0b5-4421-bf69-4c2be43ed70f taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.634283] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-99f32904-f0b5-4421-bf69-4c2be43ed70f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.634422] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-99f32904-f0b5-4421-bf69-4c2be43ed70f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.634768] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-99f32904-f0b5-4421-bf69-4c2be43ed70f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.634905] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99f32904-f0b5-4421-bf69-4c2be43ed70f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.672505] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.673268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.673268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.673268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.673268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.673268] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.673494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.673494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.673551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.673581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.673660] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 already deleted. [ 895.673736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.137869] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.138365] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.138577] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.139020] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.139278] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.140408] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 99f32904-f0b5-4421-bf69-4c2be43ed70f not found, creating... [ 896.140408] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.140780] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.141046] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.141476] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.141728] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.142442] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.143174] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.143391] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.143746] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.143963] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.144245] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 99f32904-f0b5-4421-bf69-4c2be43ed70f is going to be created. [ 896.170358] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.170781] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.170917] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.171278] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.171550] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.171810] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-99f32904-f0b5-4421-bf69-4c2be43ed70f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.652406] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f972a36b-9b6b-4a54-abd1-328458bb94ea in Status: SUCCESS [ 896.652628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.652793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.653020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.653217] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.653337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.653398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.653547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.653623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.653707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.653797] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f972a36b-9b6b-4a54-abd1-328458bb94ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.886842] env[66854]: INFO networking_nsxv3.common.synchronization [req-60c30d31-efbe-42c2-9405-c3835a8b8c72 req-8c63e66c-1ede-4fdf-bffb-afebf885b1bc service nova] Enqueued Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_rules [ 896.887079] env[66854]: INFO networking_nsxv3.common.synchronization [req-60c30d31-efbe-42c2-9405-c3835a8b8c72 req-8c63e66c-1ede-4fdf-bffb-afebf885b1bc service nova] Enqueued Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_members [ 896.887260] env[66854]: INFO networking_nsxv3.common.synchronization [req-60c30d31-efbe-42c2-9405-c3835a8b8c72 req-8c63e66c-1ede-4fdf-bffb-afebf885b1bc service nova] Enqueued Resource ID: 99f32904-f0b5-4421-bf69-4c2be43ed70f with Priority: HIGHEST for action port [ 896.887970] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_rules [ 896.889570] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_members [ 896.889729] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99f32904-f0b5-4421-bf69-4c2be43ed70f with Priority: HIGHEST for action port [ 896.890091] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.890232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.890307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.890558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.890773] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.891722] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-789c0fa6-0949-4f7b-a35b-21a28f7a5386 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.891853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.891923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.892141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.892312] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.892786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.892860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.893161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.893269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.893380] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.894747] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-99f32904-f0b5-4421-bf69-4c2be43ed70f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.894870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99f32904-f0b5-4421-bf69-4c2be43ed70f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.894937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99f32904-f0b5-4421-bf69-4c2be43ed70f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.895133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99f32904-f0b5-4421-bf69-4c2be43ed70f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.895218] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99f32904-f0b5-4421-bf69-4c2be43ed70f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.156428] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f972a36b-9b6b-4a54-abd1-328458bb94ea taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.156592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.156640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.156884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.157087] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.157772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.157902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.158158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.158572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.158572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.158732] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f972a36b-9b6b-4a54-abd1-328458bb94ea taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.158732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.158828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.158957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.159144] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.159380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.159380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.159497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.162044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.162044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.162044] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f972a36b-9b6b-4a54-abd1-328458bb94ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.318954] env[66854]: INFO networking_nsxv3.common.synchronization [req-ba4c1c9d-eae9-4266-91e8-efd756a9ea12 req-05cf468f-c9fb-4a73-9388-325e66df3f42 tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 897.319576] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 897.319921] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.320068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.320120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.320368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.320574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.320708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.320787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.320960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.321060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.321159] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.397541] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.401066] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-789c0fa6-0949-4f7b-a35b-21a28f7a5386 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.401193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.403075] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99f32904-f0b5-4421-bf69-4c2be43ed70f with status ACTIVE [ 897.403872] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.403872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.403872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.403872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.403872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.404113] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.404228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.404291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.404468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.404548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.404742] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.404858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.404917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.405133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.405133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.405326] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99f32904-f0b5-4421-bf69-4c2be43ed70f is going to be updated. [ 897.485929] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.485929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.485929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.485929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.485929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.485929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99f32904-f0b5-4421-bf69-4c2be43ed70f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.664186] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f972a36b-9b6b-4a54-abd1-328458bb94ea: rpc.has_security_group_logging(os_id): False [ 897.697182] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.697433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.697433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.697685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.697785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.698026] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.698160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.698207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.698480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.698571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.698801] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.699616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.699711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.699909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.699958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.700196] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.700872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.700872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.700872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.700872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.700872] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f972a36b-9b6b-4a54-abd1-328458bb94ea is going to be created. [ 897.789989] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.790153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.790191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.790484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.790752] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.808589] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f972a36b-9b6b-4a54-abd1-328458bb94ea in Status: IN_PROGRESS for 2s [ 897.824037] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.824215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.824215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.824431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.825201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.825201] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.825201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.825201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.826048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.826048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.826048] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 897.882271] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.882626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.882626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.883168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.883425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.903575] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.910028] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 898.010336] env[66854]: INFO networking_nsxv3.common.synchronization [req-4d5a216b-d74c-49e0-baf2-2134625a31c4 req-4aa1bf24-fa17-4525-820f-c131bcdf32e2 tempest-ImagesTestJSON-1862869845 tempest-ImagesTestJSON-1862869845-project-member] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 898.010996] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 898.011383] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.011508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.011577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.011905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.012170] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.012256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.012309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.012473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.012560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.012724] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.379000] env[66854]: INFO networking_nsxv3.common.synchronization [req-f61a6275-c9b8-4a3d-b77c-58d9ff6e97a7 req-91933c65-70fd-4a10-b19b-456ae64be76a tempest-ServersAdminTestJSON-1278843131 tempest-ServersAdminTestJSON-1278843131-project-member] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 898.379814] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 898.381939] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.381939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.381939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.381939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.381939] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.382157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.382157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.382213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.384419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.384419] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.408858] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.408858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.409454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.409454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.409454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.409454] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 is going to be created. [ 898.444259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.444415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.444477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.444688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.444854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.456982] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 in Status: UNINITIALIZED for 2s [ 898.515618] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.515820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.515820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.516107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.516141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.517296] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.517296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.517296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.517296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.517296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.517296] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 already deleted. [ 898.517296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.885791] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.920343] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.920682] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.920874] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.921402] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.921846] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.922149] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.922398] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.922858] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.923180] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.923506] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.923769] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.924041] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.924264] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.924515] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.924759] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.925151] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.946807] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.947087] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 898.947290] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.947861] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.948295] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-94a4e0e1-c523-48f5-abde-4e5185b930fc taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.948650] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-94a4e0e1-c523-48f5-abde-4e5185b930fc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.948935] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-94a4e0e1-c523-48f5-abde-4e5185b930fc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.949585] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-94a4e0e1-c523-48f5-abde-4e5185b930fc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.949716] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a4e0e1-c523-48f5-abde-4e5185b930fc',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.388690] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.454683] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.455008] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.455214] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.455545] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.455707] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.455865] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 94a4e0e1-c523-48f5-abde-4e5185b930fc not found, creating... [ 899.456540] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.456714] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.456835] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.457087] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.457212] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.457499] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.457688] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.457810] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.458033] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.458189] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.458393] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 94a4e0e1-c523-48f5-abde-4e5185b930fc is going to be created. [ 899.479240] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.479506] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.479622] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.479896] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.480143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.480366] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-94a4e0e1-c523-48f5-abde-4e5185b930fc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.824087] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f972a36b-9b6b-4a54-abd1-328458bb94ea in Status: SUCCESS [ 899.824397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.892239] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.892852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.892852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.892852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.892852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.892852] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 899.928083] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 899.928271] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 899.928381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.943294] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.943482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.943517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.943729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.943880] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.961804] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 900.230989] env[66854]: INFO networking_nsxv3.common.synchronization [req-4d5a216b-d74c-49e0-baf2-2134625a31c4 req-d2f8e13a-8571-483b-a9ac-faeeefac2e32 service nova] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_rules [ 900.231281] env[66854]: INFO networking_nsxv3.common.synchronization [req-4d5a216b-d74c-49e0-baf2-2134625a31c4 req-d2f8e13a-8571-483b-a9ac-faeeefac2e32 service nova] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 900.231369] env[66854]: INFO networking_nsxv3.common.synchronization [req-4d5a216b-d74c-49e0-baf2-2134625a31c4 req-d2f8e13a-8571-483b-a9ac-faeeefac2e32 service nova] Enqueued Resource ID: 94a4e0e1-c523-48f5-abde-4e5185b930fc with Priority: HIGHEST for action port [ 900.231877] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_rules [ 900.232024] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 900.232212] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a4e0e1-c523-48f5-abde-4e5185b930fc with Priority: HIGHEST for action port [ 900.232619] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.232722] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.232849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.233667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.233667] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.234685] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.235257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.235433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.235644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.235966] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.237156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.237156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.237156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.237156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.237156] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.238225] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-94a4e0e1-c523-48f5-abde-4e5185b930fc taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.238225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94a4e0e1-c523-48f5-abde-4e5185b930fc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.238225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94a4e0e1-c523-48f5-abde-4e5185b930fc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.238225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94a4e0e1-c523-48f5-abde-4e5185b930fc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.238225] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a4e0e1-c523-48f5-abde-4e5185b930fc',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.472643] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 in Status: SUCCESS [ 900.472643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.472643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.472643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.472643] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.472643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.472643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.472643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.472643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.472643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.472643] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.741485] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.742125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.744408] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94a4e0e1-c523-48f5-abde-4e5185b930fc with status ACTIVE [ 900.744408] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.744408] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.744408] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.744408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.744408] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94a4e0e1-c523-48f5-abde-4e5185b930fc is going to be updated. [ 900.746181] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.772389] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.772389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.772389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.772389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.772389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.772389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94a4e0e1-c523-48f5-abde-4e5185b930fc" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.977016] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.250030] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.482548] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 789c0fa6-0949-4f7b-a35b-21a28f7a5386: rpc.has_security_group_logging(os_id): False [ 901.510564] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.510768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.510803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.511030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.511122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.511385] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.511488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.511552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.511796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.511915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.512084] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 is going to be created. [ 901.595930] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.596159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.596298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.596518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.596776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.615423] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 in Status: IN_PROGRESS for 2s [ 901.654319] env[66854]: INFO networking_nsxv3.common.synchronization [req-500a40ca-4bf9-412c-aa7e-69f43ffa108f req-591b7275-3020-4890-93e9-ac1ba89a2524 tempest-ImagesOneServerNegativeTestJSON-1585579513 tempest-ImagesOneServerNegativeTestJSON-1585579513-project-member] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 901.654874] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 901.655210] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.655341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.655410] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.655615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.655837] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.656168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.656168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.656327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.656327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.656416] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.756229] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.756229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.756229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.756229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.756229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.756229] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be created. [ 901.830527] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.830690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.830796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.831088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.831269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.871641] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: UNINITIALIZED for 2s [ 901.978635] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 901.978635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.163019] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.163621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.163621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.163621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.163887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.164051] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.164192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.164297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.164576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.164674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.164812] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be updated. [ 902.199290] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.199574] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.199988] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.200441] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.200842] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.201084] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.201351] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.201628] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.201890] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.202236] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.202353] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.202488] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.202604] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.202746] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.202870] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.203817] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.207100] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.207353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.207417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.207623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.207795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.218541] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 902.230196] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.230417] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.230574] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.230792] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.231179] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-9ad5f363-7119-47eb-9cee-2256609a27f9 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.231392] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-9ad5f363-7119-47eb-9cee-2256609a27f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.231512] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-9ad5f363-7119-47eb-9cee-2256609a27f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.231951] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-9ad5f363-7119-47eb-9cee-2256609a27f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.232112] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ad5f363-7119-47eb-9cee-2256609a27f9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.735040] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.735356] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.735356] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.735669] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.735820] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.735974] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 9ad5f363-7119-47eb-9cee-2256609a27f9 not found, creating... [ 902.736305] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.736543] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.736715] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.736991] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.737174] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.737540] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.737707] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.737836] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.738054] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.738189] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.738330] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 9ad5f363-7119-47eb-9cee-2256609a27f9 is going to be created. [ 902.763664] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.763664] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.763664] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.763664] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.763664] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.763664] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-9ad5f363-7119-47eb-9cee-2256609a27f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.540612] env[66854]: INFO networking_nsxv3.common.synchronization [req-500a40ca-4bf9-412c-aa7e-69f43ffa108f req-09830d0c-c927-4f69-82e0-8d923c45937e service nova] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_rules [ 903.540863] env[66854]: INFO networking_nsxv3.common.synchronization [req-500a40ca-4bf9-412c-aa7e-69f43ffa108f req-09830d0c-c927-4f69-82e0-8d923c45937e service nova] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 903.541144] env[66854]: INFO networking_nsxv3.common.synchronization [req-500a40ca-4bf9-412c-aa7e-69f43ffa108f req-09830d0c-c927-4f69-82e0-8d923c45937e service nova] Enqueued Resource ID: 9ad5f363-7119-47eb-9cee-2256609a27f9 with Priority: HIGHEST for action port [ 903.541686] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_rules [ 903.541875] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 903.542020] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ad5f363-7119-47eb-9cee-2256609a27f9 with Priority: HIGHEST for action port [ 903.542339] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.542500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.542598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.542835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.546168] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.546168] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.546168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.546168] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ad5f363-7119-47eb-9cee-2256609a27f9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.546168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ad5f363-7119-47eb-9cee-2256609a27f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.546168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ad5f363-7119-47eb-9cee-2256609a27f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.546168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ad5f363-7119-47eb-9cee-2256609a27f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.546168] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ad5f363-7119-47eb-9cee-2256609a27f9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.628465] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 in Status: SUCCESS [ 903.628788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.883600] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 903.884639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.884720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.884944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.885156] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.885279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.885346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.885505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.885585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.885669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.885763] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.047393] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ad5f363-7119-47eb-9cee-2256609a27f9 with status ACTIVE [ 904.047674] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.047984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.047984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.048197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.048330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.048531] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.048638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.048719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.049586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.049586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.049586] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.049697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.049697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.049849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.049952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.050056] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ad5f363-7119-47eb-9cee-2256609a27f9 is going to be updated. [ 904.051625] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.051625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.078350] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.078523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.078559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.079396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.079563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.079793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ad5f363-7119-47eb-9cee-2256609a27f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.239584] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 904.239584] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce deletion is rescheduled due to dependency. [ 904.239584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.239584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.239584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.239584] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.239584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.239584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.239584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.239584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.239584] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.388386] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.388542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.388622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.389150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.389370] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.389487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.389555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.389727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.389895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.389950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.390192] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.390192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.390323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.390391] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.390528] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.390616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.390676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.390810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.390884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.390962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.391279] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.425130] env[66854]: INFO networking_nsxv3.common.synchronization [None req-cc9bccc8-b968-4d45-92ad-4b088608d7c8 None None] Enqueued Resource ID: c568144a-0a7c-46bc-9100-7843b04200a0 with Priority: HIGHEST for action port [ 904.425790] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c568144a-0a7c-46bc-9100-7843b04200a0 with Priority: HIGHEST for action port [ 904.428625] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c568144a-0a7c-46bc-9100-7843b04200a0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.428625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c568144a-0a7c-46bc-9100-7843b04200a0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.428625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c568144a-0a7c-46bc-9100-7843b04200a0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.428625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c568144a-0a7c-46bc-9100-7843b04200a0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.428625] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c568144a-0a7c-46bc-9100-7843b04200a0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.742282] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.894643] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44b9fe7e-d139-4b46-925d-7947b4b3dac9: rpc.has_security_group_logging(os_id): False [ 904.933772] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c568144a-0a7c-46bc-9100-7843b04200a0 [ 904.934308] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.935370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.935370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.935370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.935370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.935370] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c568144a-0a7c-46bc-9100-7843b04200a0 already deleted. [ 904.935370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c568144a-0a7c-46bc-9100-7843b04200a0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.942115] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.942284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.942341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.942567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.942667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.942849] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.942930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.942984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.943326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.943326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.943536] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.943639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.943705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.943851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.944044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.944988] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.944988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.944988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.944988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.944988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.944988] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be created. [ 905.015998] env[66854]: INFO networking_nsxv3.common.synchronization [req-6a2d64a6-8ff7-4b18-908f-7cea514f85bb req-8e0888e0-ad10-4f37-9149-65ff64c7d7ad tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 905.016612] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 905.020257] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.020422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.020490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.020973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.021090] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.021186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.021254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.021477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.021508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.021596] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.027040] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.027196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.027228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.027416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.027595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.042624] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 905.244969] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.523928] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.524098] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.525030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.525030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.525030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.525030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.525030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.525030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.525030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.525309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.525309] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 already deleted. [ 905.525309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.747286] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.747627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.747627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.747812] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.747919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.748038] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be updated. [ 905.786286] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.786286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.786473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.786579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.786728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.802541] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 905.945337] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-972 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.945337] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.945337] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.945846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.946134] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.946303] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.946418] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.946661] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.946800] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.947028] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.947177] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.947309] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.947426] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.947563] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.947841] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.947841] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.967625] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.967876] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.967938] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.968110] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-972" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.968442] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-bb697509-a69c-4c34-8420-21f443dd44a7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.968608] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.968730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.969078] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.969218] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb697509-a69c-4c34-8420-21f443dd44a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.345188] env[66854]: INFO networking_nsxv3.common.synchronization [None req-85cbb091-8a33-4e0e-87f4-53bad9855c16 None None] Enqueued Resource ID: 85f45cf7-645c-416d-82c6-c9280888a9ae with Priority: HIGHEST for action port [ 906.345746] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f45cf7-645c-416d-82c6-c9280888a9ae with Priority: HIGHEST for action port [ 906.346110] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-85f45cf7-645c-416d-82c6-c9280888a9ae taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.349645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85f45cf7-645c-416d-82c6-c9280888a9ae" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.349645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85f45cf7-645c-416d-82c6-c9280888a9ae" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.349645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85f45cf7-645c-416d-82c6-c9280888a9ae" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.349645] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85f45cf7-645c-416d-82c6-c9280888a9ae',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.471742] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.472740] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.472740] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.472740] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.475062] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.475062] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port bb697509-a69c-4c34-8420-21f443dd44a7 not found, creating... [ 906.475062] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.475455] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.475455] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.475865] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.476107] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.477180] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.477180] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.477180] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.478402] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.479253] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.480497] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: bb697509-a69c-4c34-8420-21f443dd44a7 is going to be created. [ 906.574269] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.574454] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.574592] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.574918] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.575249] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.575502] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.850594] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85f45cf7-645c-416d-82c6-c9280888a9ae [ 906.851449] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.852280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.852432] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.852676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.854034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.854034] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85f45cf7-645c-416d-82c6-c9280888a9ae already deleted. [ 906.854034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85f45cf7-645c-416d-82c6-c9280888a9ae" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.920194] env[66854]: INFO networking_nsxv3.common.synchronization [None req-06b86993-e1a1-4cef-a06b-10855b03008c None None] Enqueued Resource ID: a2478cce-ba6a-46cd-9916-a6a8dc8a436c with Priority: HIGHEST for action port [ 906.920753] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2478cce-ba6a-46cd-9916-a6a8dc8a436c with Priority: HIGHEST for action port [ 906.921501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2478cce-ba6a-46cd-9916-a6a8dc8a436c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.921831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2478cce-ba6a-46cd-9916-a6a8dc8a436c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.921831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2478cce-ba6a-46cd-9916-a6a8dc8a436c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.921966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2478cce-ba6a-46cd-9916-a6a8dc8a436c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.922207] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2478cce-ba6a-46cd-9916-a6a8dc8a436c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.063796] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 907.063796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.335986] env[66854]: INFO networking_nsxv3.common.synchronization [req-6a2d64a6-8ff7-4b18-908f-7cea514f85bb req-f1040e99-cea0-4717-a5ff-722eb3ca004f service nova] Enqueued Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_rules [ 907.335986] env[66854]: INFO networking_nsxv3.common.synchronization [req-6a2d64a6-8ff7-4b18-908f-7cea514f85bb req-f1040e99-cea0-4717-a5ff-722eb3ca004f service nova] Enqueued Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 907.335986] env[66854]: INFO networking_nsxv3.common.synchronization [req-6a2d64a6-8ff7-4b18-908f-7cea514f85bb req-f1040e99-cea0-4717-a5ff-722eb3ca004f service nova] Enqueued Resource ID: bb697509-a69c-4c34-8420-21f443dd44a7 with Priority: HIGHEST for action port [ 907.335986] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_rules [ 907.335986] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 907.335986] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb697509-a69c-4c34-8420-21f443dd44a7 with Priority: HIGHEST for action port [ 907.335986] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.335986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.335986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.335986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.335986] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.335986] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.335986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.335986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.335986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.335986] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.335986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.335986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.335986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.336546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.336546] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.337911] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb697509-a69c-4c34-8420-21f443dd44a7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.337911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.337911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.337911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.337911] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb697509-a69c-4c34-8420-21f443dd44a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.426702] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2478cce-ba6a-46cd-9916-a6a8dc8a436c [ 907.427434] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.427676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.427676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.428262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.428388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.428519] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2478cce-ba6a-46cd-9916-a6a8dc8a436c already deleted. [ 907.429021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2478cce-ba6a-46cd-9916-a6a8dc8a436c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.674840] env[66854]: INFO networking_nsxv3.common.synchronization [req-a0725d5d-4eca-40e3-b9b1-4d6c214d0ea9 req-492bfbe7-2941-4fc5-9a14-2d8c2a947a5e tempest-ServerTagsTestJSON-594314506 tempest-ServerTagsTestJSON-594314506-project-member] Enqueued Resource ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e with Priority: HIGHEST for action security_group_members [ 907.674840] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e with Priority: HIGHEST for action security_group_members [ 907.674840] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.675483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.675698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.677035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.677790] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.678148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.678414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.680475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.680475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.680475] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0802f3f8-30a8-41ac-b683-cb6cd9b2602e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.819033] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 907.819319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.819528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.819827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.819983] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.820267] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.820719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.820719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.820719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.820719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.820928] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.841352] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.842477] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.842605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.843012] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb697509-a69c-4c34-8420-21f443dd44a7 with status ACTIVE [ 907.843186] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.843297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.843363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.843565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.843652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.843824] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.843918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.843979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.847197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.847302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.847539] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.848851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.848930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.849203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.849296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.849402] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb697509-a69c-4c34-8420-21f443dd44a7 is going to be updated. [ 907.872565] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.872776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.872776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.873015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.873182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.873353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.095108] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-662 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.095385] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.095531] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.095893] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.096184] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.096378] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.096502] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.096802] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.096991] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.097223] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.097358] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.097470] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.097604] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.097726] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.097835] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.097970] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.118290] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.118290] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 908.118290] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.118290] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-662" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.118651] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-9b748b14-928e-4d44-adfe-b96d43a8b9c9 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.118818] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-9b748b14-928e-4d44-adfe-b96d43a8b9c9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.118943] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-9b748b14-928e-4d44-adfe-b96d43a8b9c9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.119395] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-9b748b14-928e-4d44-adfe-b96d43a8b9c9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.123022] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b748b14-928e-4d44-adfe-b96d43a8b9c9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.184446] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.184624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.184678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.184896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.185021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.185222] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.185346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.185398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.185585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.185662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.185758] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e already deleted. [ 908.185856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.325250] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.326170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.326170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.326170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.326170] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.326170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.326170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.326548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.326548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.326548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.326548] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.326684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.326684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.326848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.326947] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.327122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.327214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.327360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.327439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.327522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.327616] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.351316] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.623567] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.623882] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.624040] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.624640] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.624737] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.624815] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 9b748b14-928e-4d44-adfe-b96d43a8b9c9 not found, creating... [ 908.625128] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.625286] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.625453] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.625710] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.625847] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.626638] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.626766] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.626829] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.627070] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.627222] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.627375] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 9b748b14-928e-4d44-adfe-b96d43a8b9c9 is going to be created. [ 908.652692] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.653015] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.653150] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.653459] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.653713] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.653980] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-9b748b14-928e-4d44-adfe-b96d43a8b9c9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.829425] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc128a33-d808-470d-8d77-03637a1be1ce: rpc.has_security_group_logging(os_id): False [ 908.855358] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.855526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.855563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.855775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.855869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.856638] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.856638] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.856638] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.856638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.860422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.860422] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be updated. [ 908.860422] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.860532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.860601] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.860915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.860915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.861025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 is going to be created. [ 908.892530] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.892706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.892749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.892958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.893157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.908563] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: UNINITIALIZED for 2s [ 908.915593] env[66854]: INFO networking_nsxv3.common.synchronization [None req-a3813211-6ac6-428d-8c6e-9342fa75b717 None None] Enqueued Resource ID: 9d57e219-25c4-4c2e-b9bc-3fac32b86806 with Priority: HIGHEST for action port [ 908.916299] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d57e219-25c4-4c2e-b9bc-3fac32b86806 with Priority: HIGHEST for action port [ 908.916471] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d57e219-25c4-4c2e-b9bc-3fac32b86806 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.917316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d57e219-25c4-4c2e-b9bc-3fac32b86806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.917316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d57e219-25c4-4c2e-b9bc-3fac32b86806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.917316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d57e219-25c4-4c2e-b9bc-3fac32b86806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.917316] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d57e219-25c4-4c2e-b9bc-3fac32b86806',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.952634] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.952829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.952829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.952986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.953151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.968836] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 909.422266] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d57e219-25c4-4c2e-b9bc-3fac32b86806 [ 909.422266] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.422266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.422266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.422266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.422266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.422266] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d57e219-25c4-4c2e-b9bc-3fac32b86806 already deleted. [ 909.422266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d57e219-25c4-4c2e-b9bc-3fac32b86806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.451290] env[66854]: INFO networking_nsxv3.common.synchronization [None req-4c10e444-0f91-4588-a275-cd1ad3db8b6f tempest-ServersTestJSON-407016126 tempest-ServersTestJSON-407016126-project-member] Enqueued Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_rules [ 909.453736] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_rules [ 909.453736] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.454041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.454041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.454502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.454502] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.504247] env[66854]: INFO networking_nsxv3.common.synchronization [req-a0725d5d-4eca-40e3-b9b1-4d6c214d0ea9 req-37287b39-c112-4172-8c2d-9d2a3d60c327 service nova] Enqueued Resource ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e with Priority: HIGHEST for action security_group_rules [ 909.504536] env[66854]: INFO networking_nsxv3.common.synchronization [req-a0725d5d-4eca-40e3-b9b1-4d6c214d0ea9 req-37287b39-c112-4172-8c2d-9d2a3d60c327 service nova] Enqueued Resource ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e with Priority: HIGHEST for action security_group_members [ 909.504686] env[66854]: INFO networking_nsxv3.common.synchronization [req-a0725d5d-4eca-40e3-b9b1-4d6c214d0ea9 req-37287b39-c112-4172-8c2d-9d2a3d60c327 service nova] Enqueued Resource ID: 9b748b14-928e-4d44-adfe-b96d43a8b9c9 with Priority: HIGHEST for action port [ 909.506151] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e with Priority: HIGHEST for action security_group_rules [ 909.506151] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e with Priority: HIGHEST for action security_group_members [ 909.506151] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b748b14-928e-4d44-adfe-b96d43a8b9c9 with Priority: HIGHEST for action port [ 909.508842] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0802f3f8-30a8-41ac-b683-cb6cd9b2602e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.508985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.510182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.510182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.510182] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0802f3f8-30a8-41ac-b683-cb6cd9b2602e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.511713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.511713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.511713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.512570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.512570] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.512570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.512570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.512570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.512875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.513341] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0802f3f8-30a8-41ac-b683-cb6cd9b2602e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.515767] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b748b14-928e-4d44-adfe-b96d43a8b9c9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.516296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b748b14-928e-4d44-adfe-b96d43a8b9c9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.516422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b748b14-928e-4d44-adfe-b96d43a8b9c9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.516665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b748b14-928e-4d44-adfe-b96d43a8b9c9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.516830] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b748b14-928e-4d44-adfe-b96d43a8b9c9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.669288] env[66854]: INFO networking_nsxv3.common.synchronization [None req-84b89828-0e58-4141-8e21-eb26eae19375 tempest-ServersTestJSON-407016126 tempest-ServersTestJSON-407016126-project-member] Enqueued Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_rules [ 909.670388] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_rules [ 909.670975] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.671149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.980788] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.981110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.981110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.981271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.981339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.981432] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 already deleted. [ 909.981512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.981740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.981947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.982014] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.022070] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0802f3f8-30a8-41ac-b683-cb6cd9b2602e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.023816] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.023816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.023991] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b748b14-928e-4d44-adfe-b96d43a8b9c9 with status ACTIVE [ 910.024086] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.024191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.024267] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.024502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.024700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.024766] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.024858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.024920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.026464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.027556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.028686] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.028686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.028686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.028913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.028913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.028913] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b748b14-928e-4d44-adfe-b96d43a8b9c9 is going to be updated. [ 910.069744] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.069941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.070033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.070777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.070777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.074710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b748b14-928e-4d44-adfe-b96d43a8b9c9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.515344] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.515857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.515857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.516845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.516845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.516845] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 already deleted. [ 910.516845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.533566] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0802f3f8-30a8-41ac-b683-cb6cd9b2602e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.923081] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: SUCCESS [ 910.923401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.923719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.924877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.924877] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.924877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.924877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.924877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.925224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.925367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.926597] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.986998] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 910.987373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.035606] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.035775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.035850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.036078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.036171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.036273] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e is going to be created. [ 911.063396] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.063620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.063620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.064338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.064569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.076864] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e in Status: UNINITIALIZED for 2s [ 911.428218] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.428465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.428710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.428968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.429746] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.429746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.429746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.429910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.430018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.430960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.430960] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.430960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.430960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.431539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.431911] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.432141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.432305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.432594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.433570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.433570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.433689] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.540596] env[66854]: INFO networking_nsxv3.common.synchronization [req-471d4e1e-0e71-4741-b8ae-053e9afb5e00 req-3cce59f0-ce06-473c-b3ef-c5365c8d33b1 tempest-ServersTestFqdnHostnames-796960008 tempest-ServersTestFqdnHostnames-796960008-project-member] Enqueued Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_members [ 911.541221] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGHEST for action security_group_members [ 911.541670] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-db9d8667-c0a3-4930-8f4b-8672f1d358e9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.541832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.541832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.542168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.542300] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.542482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.542647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.542991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.542991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.543196] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.937245] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 803ac34f-a70c-44ba-9693-3e4cba201877: rpc.has_security_group_logging(os_id): False [ 911.967315] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.967315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.967559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.967591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.967687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.967883] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.967985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.968061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.968215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.968333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.968490] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.968587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.968652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.968795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.968899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.969309] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.969547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.969663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.969856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.969979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.970123] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 is going to be created. [ 912.046523] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.046523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.046523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.046523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.046523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.047289] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.047493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.047616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.047837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.072125] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: IN_PROGRESS for 2s [ 912.098541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.098825] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.098948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.099026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.099234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.099334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.099410] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 is going to be updated. [ 912.147873] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.148240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.148320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.148887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.148887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.164921] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 in Status: IN_PROGRESS for 2s [ 913.092102] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e in Status: SUCCESS [ 913.093145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.093145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.093145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.093368] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.093431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.094051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.094051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.094051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.094051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.094411] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0802f3f8-30a8-41ac-b683-cb6cd9b2602e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.596611] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.596838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.596912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.597157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.597332] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.597438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.597621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.597818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.598101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.598218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.598559] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.598559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.598559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.598701] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.598845] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.598950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.599049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.599212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.599290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.599376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.599483] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0802f3f8-30a8-41ac-b683-cb6cd9b2602e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.942576] env[66854]: INFO networking_nsxv3.common.synchronization [req-6c11f966-8455-4fc6-a939-4dfacb84a696 req-335e0e12-24cd-456f-b277-7c15f5f9bb03 tempest-ListServerFiltersTestJSON-732493998 tempest-ListServerFiltersTestJSON-732493998-project-member] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 913.946047] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 913.946937] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.947083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.947630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.947946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.948786] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.948786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.948926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.949572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.949777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.949977] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.085920] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: SUCCESS [ 914.088670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.102667] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0802f3f8-30a8-41ac-b683-cb6cd9b2602e: rpc.has_security_group_logging(os_id): False [ 914.124995] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.125284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.126359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.126359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.126359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.126359] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.126359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.126359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.126359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.126599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.127785] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.127785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.127785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.127785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.127785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.127785] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.127785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.128083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.128083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.128083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.128285] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e is going to be created. [ 914.185573] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 in Status: SUCCESS [ 914.185573] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 deletion is rescheduled due to dependency. [ 914.185573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.211148] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.211441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.211441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.212887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.212887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.225569] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e in Status: IN_PROGRESS for 2s [ 914.456556] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.960412] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.184114] env[66854]: INFO networking_nsxv3.common.synchronization [req-4a920ef9-893d-4117-b60c-913351ed765d req-2c672eec-94be-40ec-bf69-00a16d5e44cb tempest-ServerAddressesTestJSON-779304346 tempest-ServerAddressesTestJSON-779304346-project-member] Enqueued Resource ID: f972a36b-9b6b-4a54-abd1-328458bb94ea with Priority: HIGHEST for action security_group_members [ 915.184114] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f972a36b-9b6b-4a54-abd1-328458bb94ea with Priority: HIGHEST for action security_group_members [ 915.184412] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f972a36b-9b6b-4a54-abd1-328458bb94ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.184412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.184412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.184566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.184693] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.184795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.185274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.185274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.185274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.185274] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f972a36b-9b6b-4a54-abd1-328458bb94ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.463529] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.463855] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.464021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.464355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.466153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.466153] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be updated. [ 915.516476] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.516815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.517809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.521234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.521234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.540094] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: IN_PROGRESS for 2s [ 915.691354] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.691354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.691354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.691354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.691354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.691354] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.691354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.691354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.691354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.691642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.691642] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f972a36b-9b6b-4a54-abd1-328458bb94ea is going to be updated. [ 915.725448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.725448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.725448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.725448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.725448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.735035] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f972a36b-9b6b-4a54-abd1-328458bb94ea in Status: IN_PROGRESS for 2s [ 916.240709] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e in Status: SUCCESS [ 916.241088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.603789] env[66854]: INFO networking_nsxv3.common.synchronization [None req-f7c93897-5e8d-423f-a9c4-cda69db33e96 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 85e6abbf-de31-4bf6-b610-e727ddf45e8f with Priority: HIGHEST for action security_group_rules [ 916.605088] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85e6abbf-de31-4bf6-b610-e727ddf45e8f with Priority: HIGHEST for action security_group_rules [ 916.605737] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85e6abbf-de31-4bf6-b610-e727ddf45e8f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.605950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85e6abbf-de31-4bf6-b610-e727ddf45e8f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.606330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85e6abbf-de31-4bf6-b610-e727ddf45e8f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.606844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85e6abbf-de31-4bf6-b610-e727ddf45e8f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.607223] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85e6abbf-de31-4bf6-b610-e727ddf45e8f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.699278] env[66854]: INFO networking_nsxv3.common.synchronization [None req-aa454471-f3a4-495d-82a2-e1bc70ba1b6f tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 85e6abbf-de31-4bf6-b610-e727ddf45e8f with Priority: HIGHEST for action security_group_rules [ 916.699278] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85e6abbf-de31-4bf6-b610-e727ddf45e8f with Priority: HIGHEST for action security_group_rules [ 916.699828] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85e6abbf-de31-4bf6-b610-e727ddf45e8f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.700283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85e6abbf-de31-4bf6-b610-e727ddf45e8f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.131324] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.131465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.131543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.131761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.131855] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.131966] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85e6abbf-de31-4bf6-b610-e727ddf45e8f already deleted. [ 917.132046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85e6abbf-de31-4bf6-b610-e727ddf45e8f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.132231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85e6abbf-de31-4bf6-b610-e727ddf45e8f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.132387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85e6abbf-de31-4bf6-b610-e727ddf45e8f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.132472] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85e6abbf-de31-4bf6-b610-e727ddf45e8f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.548924] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 917.550368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.666240] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.667043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.667043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.667043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.667043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.667043] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85e6abbf-de31-4bf6-b610-e727ddf45e8f already deleted. [ 917.667287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85e6abbf-de31-4bf6-b610-e727ddf45e8f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.745889] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f972a36b-9b6b-4a54-abd1-328458bb94ea in Status: SUCCESS [ 917.746198] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f972a36b-9b6b-4a54-abd1-328458bb94ea deletion is rescheduled due to dependency. [ 917.746352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.449747] env[66854]: INFO networking_nsxv3.common.synchronization [req-6df0c32a-7988-4fa4-a11d-3a07d95db4f9 req-fa9c6b2b-e28b-4bbf-b7b6-04c9af07c7d7 tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 919.454386] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 919.454689] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.454892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.454957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.455244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.455510] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.455615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.455668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.455938] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.456036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.456164] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.475232] env[66854]: INFO networking_nsxv3.common.synchronization [req-6df0c32a-7988-4fa4-a11d-3a07d95db4f9 req-fa9c6b2b-e28b-4bbf-b7b6-04c9af07c7d7 tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_rules [ 919.475379] env[66854]: INFO networking_nsxv3.common.synchronization [req-6df0c32a-7988-4fa4-a11d-3a07d95db4f9 req-fa9c6b2b-e28b-4bbf-b7b6-04c9af07c7d7 tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 919.475572] env[66854]: INFO networking_nsxv3.common.synchronization [req-6df0c32a-7988-4fa4-a11d-3a07d95db4f9 req-fa9c6b2b-e28b-4bbf-b7b6-04c9af07c7d7 tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: ffe1e47e-cc58-43c3-bf93-e4cad5cba830 with Priority: HIGHEST for action port [ 919.477609] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_rules [ 919.477609] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 919.477609] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe1e47e-cc58-43c3-bf93-e4cad5cba830 with Priority: HIGHEST for action port [ 919.477609] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.477609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.477609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.477788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.477984] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.478964] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.482045] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.482390] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.482552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.482625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.482888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.482986] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffe1e47e-cc58-43c3-bf93-e4cad5cba830',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.963959] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.985153] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.985344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.985511] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffe1e47e-cc58-43c3-bf93-e4cad5cba830 with status ACTIVE [ 919.985687] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.985792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.986051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.986177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.986177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.986358] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.986455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.986513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.986669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.986747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.986956] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.987039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.987089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.987213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.987285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.987368] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffe1e47e-cc58-43c3-bf93-e4cad5cba830 is going to be updated. [ 920.013602] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.017135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.017342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.017677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.017871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.018191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.419421] env[66854]: INFO networking_nsxv3.common.synchronization [req-3f936e2a-520f-4fb7-be5b-7330dab5f895 req-295e1541-39d9-49dc-aa6f-7646abf8c1fe tempest-ServersAdminTestJSON-1278843131 tempest-ServersAdminTestJSON-1278843131-project-member] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 920.419819] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 920.420873] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.420873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.420873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.420873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.420873] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.420873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.420873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.421361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.421361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.421466] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.466515] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.504921] env[66854]: INFO networking_nsxv3.common.synchronization [req-26daea35-e203-4e33-9377-07d3460727e9 req-3ecc1eba-7c76-41e9-80a3-8fa056e920aa tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 920.505802] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 920.506403] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.506566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.507749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.507749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.507749] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.507749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.507749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.507749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.507749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.507749] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.920494] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-541 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.920738] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.920845] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.921322] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.921880] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.922143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.922266] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.922913] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.923161] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.923492] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.923693] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.923878] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.924075] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.924302] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.924480] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.924727] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.926877] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.965051] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.965051] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 920.965051] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.965347] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.965584] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-10ed44ec-5865-42b0-bec4-0835231840c4 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.965797] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-10ed44ec-5865-42b0-bec4-0835231840c4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.965918] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-10ed44ec-5865-42b0-bec4-0835231840c4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.966257] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-10ed44ec-5865-42b0-bec4-0835231840c4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.966394] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ed44ec-5865-42b0-bec4-0835231840c4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.970808] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.970808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.970808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.970808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.970808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.971119] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a is going to be updated. [ 921.011668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.011668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.011668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.011668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.011668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.011668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.011668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.011668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.011668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.011668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.011668] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 already deleted. [ 921.011668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.040466] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.041147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.041147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.041147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.041147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.059980] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: IN_PROGRESS for 2s [ 921.429899] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.470115] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.470115] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.470115] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.470115] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.470115] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.470512] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 10ed44ec-5865-42b0-bec4-0835231840c4 not found, creating... [ 921.470512] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.470725] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.470832] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.474846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.474846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.474846] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.474846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.474846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.474846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.474846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.474846] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 10ed44ec-5865-42b0-bec4-0835231840c4 is going to be created. [ 921.497927] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.498304] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.498511] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.498840] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.499096] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.499413] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-10ed44ec-5865-42b0-bec4-0835231840c4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.932730] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.932914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.932989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.933243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.933337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.933441] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 922.017898] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.018092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.018213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.018412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.018566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.039988] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 922.264496] env[66854]: INFO networking_nsxv3.common.synchronization [req-26daea35-e203-4e33-9377-07d3460727e9 req-96407ec0-18de-46f3-9847-cc6dda679b5d service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 922.264686] env[66854]: INFO networking_nsxv3.common.synchronization [req-26daea35-e203-4e33-9377-07d3460727e9 req-96407ec0-18de-46f3-9847-cc6dda679b5d service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 922.264821] env[66854]: INFO networking_nsxv3.common.synchronization [req-26daea35-e203-4e33-9377-07d3460727e9 req-96407ec0-18de-46f3-9847-cc6dda679b5d service nova] Enqueued Resource ID: 10ed44ec-5865-42b0-bec4-0835231840c4 with Priority: HIGHEST for action port [ 922.265376] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 922.265597] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 922.265756] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ed44ec-5865-42b0-bec4-0835231840c4 with Priority: HIGHEST for action port [ 922.267645] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.267796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.267897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.268150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.268480] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.269459] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.269594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.269681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.269875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.270050] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.270171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.270241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.270483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.270565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.270660] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.271592] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-10ed44ec-5865-42b0-bec4-0835231840c4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.271913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10ed44ec-5865-42b0-bec4-0835231840c4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.271913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10ed44ec-5865-42b0-bec4-0835231840c4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.271913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10ed44ec-5865-42b0-bec4-0835231840c4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.271987] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ed44ec-5865-42b0-bec4-0835231840c4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.443582] env[66854]: INFO networking_nsxv3.common.synchronization [req-a94edcd2-3b20-46a2-b457-59c23a325d64 req-1ee619e5-0d36-4ab0-a54a-2233427f4a11 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 922.444093] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 922.444448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.444789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.444789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.444918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.445075] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.445225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.445343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.445596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.445779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.445913] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.774697] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.775024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.775024] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.775966] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10ed44ec-5865-42b0-bec4-0835231840c4 with status ACTIVE [ 922.776246] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.776378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.776788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.776788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.776788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.778116] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.778116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.778116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.778116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.778116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.778116] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.778116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.778505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.778505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.778685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.778779] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10ed44ec-5865-42b0-bec4-0835231840c4 is going to be updated. [ 922.812168] env[66854]: INFO networking_nsxv3.common.synchronization [req-05af0525-1600-4bf3-b62e-785fbded03e8 req-045891a5-39b9-4d2c-aae6-c272491d39a2 tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 922.814776] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.814776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.814776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.814776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.814776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.814776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10ed44ec-5865-42b0-bec4-0835231840c4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.815239] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 922.815582] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.815684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.836024] env[66854]: INFO networking_nsxv3.common.synchronization [req-05af0525-1600-4bf3-b62e-785fbded03e8 req-045891a5-39b9-4d2c-aae6-c272491d39a2 tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_rules [ 922.836171] env[66854]: INFO networking_nsxv3.common.synchronization [req-05af0525-1600-4bf3-b62e-785fbded03e8 req-045891a5-39b9-4d2c-aae6-c272491d39a2 tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 922.837606] env[66854]: INFO networking_nsxv3.common.synchronization [req-05af0525-1600-4bf3-b62e-785fbded03e8 req-045891a5-39b9-4d2c-aae6-c272491d39a2 tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: ffe1e47e-cc58-43c3-bf93-e4cad5cba830 with Priority: HIGHEST for action port [ 922.838044] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_rules [ 922.838153] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 922.838249] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe1e47e-cc58-43c3-bf93-e4cad5cba830 with Priority: HIGHEST for action port [ 922.838741] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.839146] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.839713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.839830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.840102] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.840234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.840300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.840646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.841187] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffe1e47e-cc58-43c3-bf93-e4cad5cba830',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.952781] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.952781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.952781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.952781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.953112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.953112] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.953210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.953276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.953474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.953556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.953649] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 923.005665] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.005803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.005869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.006129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.006277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.021660] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 923.071852] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: SUCCESS [ 923.072046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.072360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.072360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.072537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.072632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.072691] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.073084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.073084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.073084] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.280809] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.346036] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffe1e47e-cc58-43c3-bf93-e4cad5cba830 with status ACTIVE [ 923.346036] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.346492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.346492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.346735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.346875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.347141] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.347311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.347451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.347676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.347789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.347973] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.348087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.348181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.348316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.348393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.348547] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffe1e47e-cc58-43c3-bf93-e4cad5cba830 is going to be updated. [ 923.376406] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.376406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.376406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.376406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.376699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.376939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffe1e47e-cc58-43c3-bf93-e4cad5cba830" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.576117] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.784634] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.785068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.785068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.785334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.785334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.785492] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be created. [ 923.831404] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.831854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.832022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.832263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.832541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.854378] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: UNINITIALIZED for 2s [ 924.052131] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 924.052359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.080929] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.322436] env[66854]: INFO networking_nsxv3.common.synchronization [req-c828e449-65ef-4607-82fb-cd84b875f47a req-b7e25c70-3d3a-497a-adbc-4e79f5a21332 tempest-ServerTagsTestJSON-594314506 tempest-ServerTagsTestJSON-594314506-project-member] Enqueued Resource ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e with Priority: HIGHEST for action security_group_members [ 924.323182] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e with Priority: HIGHEST for action security_group_members [ 924.323593] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.323762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.323875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.324127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.324638] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.324638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.324638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.325187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.325187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.325187] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0802f3f8-30a8-41ac-b683-cb6cd9b2602e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.585345] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.585573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.585732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.586015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.586105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.586239] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a is going to be updated. [ 924.626381] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.626588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.626588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.626817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.626967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.639571] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: IN_PROGRESS for 2s [ 924.832534] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.833019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.833019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.833190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.833321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.833689] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.833840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.834016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.834163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.834291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.834428] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e is going to be updated. [ 924.864620] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.864792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.864860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.865106] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.865293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.875546] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e in Status: IN_PROGRESS for 2s [ 925.029770] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 925.029974] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 deletion is rescheduled due to dependency. [ 925.030107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.865249] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 925.865543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.865683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.865925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.866156] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.866293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.866359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.866531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.866613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.866698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.866793] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.371301] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.371488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.371567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.371903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.372104] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.372291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.372354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.372521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.372665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.372732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.372949] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.373138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.373138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.373329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.373490] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.373608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.373655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.374222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.374222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.374222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.374222] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.652058] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: SUCCESS [ 926.653083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.653083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.653083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.653083] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.653083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.653083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.653442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.653442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.653442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.653524] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.654552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.654852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.655092] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.655221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.655356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.655528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.655620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.655750] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.878119] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6779288d-3538-4416-9c3b-5f739846d8f3: rpc.has_security_group_logging(os_id): False [ 926.895451] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e in Status: SUCCESS [ 926.895791] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e deletion is rescheduled due to dependency. [ 926.895888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.902223] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.902458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.902569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.902781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.903687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.903687] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.903687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.903687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.904182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.904376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.904580] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.905127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.905127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.905127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.905127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.905365] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.905365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.905453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.905586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.905697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.905861] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be created. [ 927.003741] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.003996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.004245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.004498] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.004762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.022055] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 927.160018] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.162863] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.410265] env[66854]: INFO networking_nsxv3.common.synchronization [req-6032f7eb-bfbc-4443-ac18-45a40e29e986 req-491a4824-da1b-4722-845c-7649322764ea tempest-AttachInterfacesUnderV243Test-442186073 tempest-AttachInterfacesUnderV243Test-442186073-project-member] Enqueued Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 927.411100] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a with Priority: HIGHEST for action security_group_members [ 927.411459] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f42aff-e1af-41a3-a87d-1db3a0580e1a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.411585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.663341] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12f42aff-e1af-41a3-a87d-1db3a0580e1a: rpc.has_security_group_logging(os_id): False [ 927.670843] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.686892] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.686987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.687084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.687319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.687428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.687729] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.687845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.687913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.688916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.688916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.688916] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a is going to be updated. [ 927.755702] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.755702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.755702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.755702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.755702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.773237] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: IN_PROGRESS for 2s [ 927.823403] env[66854]: INFO networking_nsxv3.common.synchronization [req-f8a0836a-5e4d-4e07-85e8-d2bce25bb964 req-beaa58f8-5a1a-4651-9902-3600d4556b95 tempest-ImagesOneServerNegativeTestJSON-1585579513 tempest-ImagesOneServerNegativeTestJSON-1585579513-project-member] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 927.823403] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 927.823403] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.823403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.823403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.823403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.823403] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.823403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.823403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.823403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.823403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.823403] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.174476] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.174837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.174837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.175133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.175322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.175451] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a is going to be updated. [ 928.212024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.212024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.212024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.212290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.212365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.225035] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: IN_PROGRESS for 2s [ 928.331284] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.331284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.331448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.331551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.331682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.331859] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.331968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.332059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.332221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.332300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.332393] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be updated. [ 928.379017] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.379017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.379017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.379215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.379361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.392709] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 928.595980] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e8dff3ea-1c75-4451-bce8-db22064be27c None None] Enqueued Resource ID: 79d8fb65-5a85-411a-a9e7-8c69d6d8d4bb with Priority: HIGHEST for action port [ 928.595980] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79d8fb65-5a85-411a-a9e7-8c69d6d8d4bb with Priority: HIGHEST for action port [ 928.597470] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-79d8fb65-5a85-411a-a9e7-8c69d6d8d4bb taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.597653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79d8fb65-5a85-411a-a9e7-8c69d6d8d4bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.597724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79d8fb65-5a85-411a-a9e7-8c69d6d8d4bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.598039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79d8fb65-5a85-411a-a9e7-8c69d6d8d4bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.598129] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79d8fb65-5a85-411a-a9e7-8c69d6d8d4bb',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.691023] env[66854]: INFO networking_nsxv3.common.synchronization [req-f68ab9a8-1e35-4227-b841-89a3cb4d635f req-2599c7e0-5358-42ed-b829-183e7de94dd9 tempest-ServersTestJSON-407016126 tempest-ServersTestJSON-407016126-project-member] Enqueued Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_members [ 928.691023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_members [ 928.691023] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-da272d22-fe1c-4363-b694-0fd0d1bea6e5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.691440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.691564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.693154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.693730] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.696196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.696278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.696492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.696588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.696713] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.035668] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 929.035668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.076281] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-825 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.076281] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-825" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.076281] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-825" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.078165] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-825" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.078825] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.079365] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.080327] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.080327] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.080683] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.081123] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.081389] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.084417] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.084417] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.084417] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.084417] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.084417] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.104635] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79d8fb65-5a85-411a-a9e7-8c69d6d8d4bb [ 929.104635] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.104635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.104635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.104635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.104635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.104635] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79d8fb65-5a85-411a-a9e7-8c69d6d8d4bb already deleted. [ 929.104635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79d8fb65-5a85-411a-a9e7-8c69d6d8d4bb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.109191] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.109561] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 929.109807] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.110098] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-825" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.110501] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-3edf513b-7055-4ddd-bfb6-fdd9d878539f taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.110853] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-3edf513b-7055-4ddd-bfb6-fdd9d878539f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.111240] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-3edf513b-7055-4ddd-bfb6-fdd9d878539f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.111668] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-3edf513b-7055-4ddd-bfb6-fdd9d878539f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.111921] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3edf513b-7055-4ddd-bfb6-fdd9d878539f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.204021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.204395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.204395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.204616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.204767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.206273] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.206273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.206273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.206273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.206273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.206273] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 already deleted. [ 929.206273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.310027] env[66854]: INFO networking_nsxv3.common.synchronization [req-2256626c-5e53-4b2f-aaa6-fd2ff42818d9 req-93f53dd0-a89e-4e5d-9879-8b93d8989151 tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: e8211522-f806-4e6b-bb2f-9669205024de with Priority: HIGHEST for action security_group_members [ 929.310027] env[66854]: INFO networking_nsxv3.common.synchronization [req-2256626c-5e53-4b2f-aaa6-fd2ff42818d9 req-93f53dd0-a89e-4e5d-9879-8b93d8989151 tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 929.310271] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8211522-f806-4e6b-bb2f-9669205024de with Priority: HIGHEST for action security_group_members [ 929.310462] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 929.310875] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8211522-f806-4e6b-bb2f-9669205024de taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.311137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.311238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.311517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.311726] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.311848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.311917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.312255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.312368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.312494] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8211522-f806-4e6b-bb2f-9669205024de',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.313565] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.313749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.313847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.314058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.314248] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.314375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.314459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.314609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.314735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.314839] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.361915] env[66854]: INFO networking_nsxv3.common.synchronization [req-2256626c-5e53-4b2f-aaa6-fd2ff42818d9 req-93f53dd0-a89e-4e5d-9879-8b93d8989151 tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_rules [ 929.362216] env[66854]: INFO networking_nsxv3.common.synchronization [req-2256626c-5e53-4b2f-aaa6-fd2ff42818d9 req-93f53dd0-a89e-4e5d-9879-8b93d8989151 tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 929.362427] env[66854]: INFO networking_nsxv3.common.synchronization [req-2256626c-5e53-4b2f-aaa6-fd2ff42818d9 req-93f53dd0-a89e-4e5d-9879-8b93d8989151 tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: e8211522-f806-4e6b-bb2f-9669205024de with Priority: HIGHEST for action security_group_rules [ 929.362649] env[66854]: INFO networking_nsxv3.common.synchronization [req-2256626c-5e53-4b2f-aaa6-fd2ff42818d9 req-93f53dd0-a89e-4e5d-9879-8b93d8989151 tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: e8211522-f806-4e6b-bb2f-9669205024de with Priority: HIGHEST for action security_group_members [ 929.362824] env[66854]: INFO networking_nsxv3.common.synchronization [req-2256626c-5e53-4b2f-aaa6-fd2ff42818d9 req-93f53dd0-a89e-4e5d-9879-8b93d8989151 tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: bb697509-a69c-4c34-8420-21f443dd44a7 with Priority: HIGHEST for action port [ 929.363482] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_rules [ 929.363675] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8211522-f806-4e6b-bb2f-9669205024de with Priority: HIGHEST for action security_group_rules [ 929.363795] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb697509-a69c-4c34-8420-21f443dd44a7 with Priority: HIGHEST for action port [ 929.363935] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 929.364115] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8211522-f806-4e6b-bb2f-9669205024de with Priority: HIGHEST for action security_group_members [ 929.364445] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.364609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.364781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.364965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.365111] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.366491] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8211522-f806-4e6b-bb2f-9669205024de taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.366671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.366763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.367047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.367172] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8211522-f806-4e6b-bb2f-9669205024de',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.368104] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb697509-a69c-4c34-8420-21f443dd44a7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.368236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.368322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.368497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.368603] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb697509-a69c-4c34-8420-21f443dd44a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.369489] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.369609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.369830] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8211522-f806-4e6b-bb2f-9669205024de taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.369944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.615301] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.615498] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.615553] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.615840] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.617023] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.617023] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 3edf513b-7055-4ddd-bfb6-fdd9d878539f not found, creating... [ 929.617023] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.617023] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.617023] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.617023] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.617334] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.617923] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.618054] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.618140] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.618383] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.618522] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.618665] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 3edf513b-7055-4ddd-bfb6-fdd9d878539f is going to be created. [ 929.647043] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.647308] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.647837] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.647837] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.647995] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.648229] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-3edf513b-7055-4ddd-bfb6-fdd9d878539f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.809104] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: SUCCESS [ 929.809563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.810044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.810317] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.810432] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.817356] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8211522-f806-4e6b-bb2f-9669205024de',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.818639] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.872700] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.872831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.874276] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8211522-f806-4e6b-bb2f-9669205024de taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.874425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.874530] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb697509-a69c-4c34-8420-21f443dd44a7 with status ACTIVE [ 929.874701] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.874817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.874884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.875135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.875252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.875424] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.875545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.875613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.875772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.875864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.876060] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.876155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.876216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.876352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.876425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.876525] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb697509-a69c-4c34-8420-21f443dd44a7 is going to be updated. [ 929.902984] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.903193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.903268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.903519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.903711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.903906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.147787] env[66854]: INFO networking_nsxv3.common.synchronization [req-88d200c2-61e6-45db-8d11-9c82b1e273ac req-41c67bea-61aa-4574-a73d-3111d759131f tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: e8211522-f806-4e6b-bb2f-9669205024de with Priority: HIGHEST for action security_group_members [ 930.147982] env[66854]: INFO networking_nsxv3.common.synchronization [req-88d200c2-61e6-45db-8d11-9c82b1e273ac req-41c67bea-61aa-4574-a73d-3111d759131f tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 930.149478] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8211522-f806-4e6b-bb2f-9669205024de with Priority: HIGHEST for action security_group_members [ 930.149478] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 930.149478] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8211522-f806-4e6b-bb2f-9669205024de taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.149478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.149478] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.149478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.217140] env[66854]: INFO networking_nsxv3.common.synchronization [req-88d200c2-61e6-45db-8d11-9c82b1e273ac req-41c67bea-61aa-4574-a73d-3111d759131f tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_rules [ 930.217492] env[66854]: INFO networking_nsxv3.common.synchronization [req-88d200c2-61e6-45db-8d11-9c82b1e273ac req-41c67bea-61aa-4574-a73d-3111d759131f tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 930.219055] env[66854]: INFO networking_nsxv3.common.synchronization [req-88d200c2-61e6-45db-8d11-9c82b1e273ac req-41c67bea-61aa-4574-a73d-3111d759131f tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: bb697509-a69c-4c34-8420-21f443dd44a7 with Priority: HIGHEST for action port [ 930.219055] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_rules [ 930.219055] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 930.219055] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb697509-a69c-4c34-8420-21f443dd44a7 with Priority: HIGHEST for action port [ 930.219344] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.219344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.219493] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.219605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.221157] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb697509-a69c-4c34-8420-21f443dd44a7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.221157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.221157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.221157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.221157] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb697509-a69c-4c34-8420-21f443dd44a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.238982] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a in Status: SUCCESS [ 930.238982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.239636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.240713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.240713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.240713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.240713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.240713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.240713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.241222] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.321414] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8211522-f806-4e6b-bb2f-9669205024de',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.322499] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.340714] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.340968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.340968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.341243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.341343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.341559] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a is going to be deleted. [ 930.410477] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 930.410639] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce deletion is rescheduled due to dependency. [ 930.410759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.469122] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.471830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.471830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.471830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.471830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.471830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.485384] env[66854]: INFO networking_nsxv3.common.synchronization [req-f68ab9a8-1e35-4227-b841-89a3cb4d635f req-8bfaf7c7-a313-428a-9bd5-3b6b930d6770 service nova] Enqueued Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_rules [ 930.486186] env[66854]: INFO networking_nsxv3.common.synchronization [req-f68ab9a8-1e35-4227-b841-89a3cb4d635f req-8bfaf7c7-a313-428a-9bd5-3b6b930d6770 service nova] Enqueued Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_members [ 930.486469] env[66854]: INFO networking_nsxv3.common.synchronization [req-f68ab9a8-1e35-4227-b841-89a3cb4d635f req-8bfaf7c7-a313-428a-9bd5-3b6b930d6770 service nova] Enqueued Resource ID: 3edf513b-7055-4ddd-bfb6-fdd9d878539f with Priority: HIGHEST for action port [ 930.487569] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_rules [ 930.487852] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_members [ 930.488075] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3edf513b-7055-4ddd-bfb6-fdd9d878539f with Priority: HIGHEST for action port [ 930.488593] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.488846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.489106] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.489416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.489672] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.491811] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-da272d22-fe1c-4363-b694-0fd0d1bea6e5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.491811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.491811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.492182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.492487] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.493362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.493585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.493944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.494737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.494737] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.495496] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3edf513b-7055-4ddd-bfb6-fdd9d878539f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.495662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3edf513b-7055-4ddd-bfb6-fdd9d878539f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.495662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3edf513b-7055-4ddd-bfb6-fdd9d878539f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.495989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3edf513b-7055-4ddd-bfb6-fdd9d878539f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.495989] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3edf513b-7055-4ddd-bfb6-fdd9d878539f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.727837] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb697509-a69c-4c34-8420-21f443dd44a7 with status ACTIVE [ 930.728093] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.728235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.728305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.728551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.728912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.729149] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.729273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.729345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.729594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.729717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.730040] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.730169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.730312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.730444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.730527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.730653] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb697509-a69c-4c34-8420-21f443dd44a7 is going to be updated. [ 930.743872] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.744072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.744150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.744381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.744492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.744716] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.744832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.744898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.746199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.746199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.746199] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a is going to be deleted. [ 930.761646] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.761815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.761894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.762204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.762365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.762556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb697509-a69c-4c34-8420-21f443dd44a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.789429] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.789842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.789963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.790233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.790338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.790534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.791086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.791696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.791696] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.791819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.791900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.792782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.792998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.793349] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f42aff-e1af-41a3-a87d-1db3a0580e1a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.825045] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.825204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.825204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.825482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.825516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.825843] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8211522-f806-4e6b-bb2f-9669205024de is going to be created. [ 930.827187] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.827348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.827418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.827653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.827740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.827808] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 is going to be updated. [ 930.894786] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.894786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.894786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.894786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.894786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.912335] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.912510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.912586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.912812] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.912976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.916530] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8211522-f806-4e6b-bb2f-9669205024de in Status: UNINITIALIZED for 2s [ 930.928123] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: IN_PROGRESS for 2s [ 931.000776] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3edf513b-7055-4ddd-bfb6-fdd9d878539f with status ACTIVE [ 931.000776] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.000776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.000776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.000776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.001091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.001091] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.001175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.001237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.001409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.001511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.001666] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.001757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.001818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.001952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.002033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.002119] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3edf513b-7055-4ddd-bfb6-fdd9d878539f is going to be updated. [ 931.004329] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.007031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-da272d22-fe1c-4363-b694-0fd0d1bea6e5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.007197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.034373] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.034559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.034705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.034849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.034995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.035189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3edf513b-7055-4ddd-bfb6-fdd9d878539f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.106307] env[66854]: INFO networking_nsxv3.common.synchronization [None req-3558a44f-6b15-450f-84b7-8e5e8b91ba65 None None] Enqueued Resource ID: 9820df77-8912-404f-b55d-4187d2dd9605 with Priority: HIGHEST for action port [ 931.106919] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9820df77-8912-404f-b55d-4187d2dd9605 with Priority: HIGHEST for action port [ 931.107268] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-9820df77-8912-404f-b55d-4187d2dd9605 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.107412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9820df77-8912-404f-b55d-4187d2dd9605" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.107480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9820df77-8912-404f-b55d-4187d2dd9605" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.107845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9820df77-8912-404f-b55d-4187d2dd9605" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.107939] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9820df77-8912-404f-b55d-4187d2dd9605',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.300000] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.300000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.300000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.300000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.300000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.300790] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.300790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.300790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.300790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.300790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.300790] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f42aff-e1af-41a3-a87d-1db3a0580e1a already deleted. [ 931.300790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f42aff-e1af-41a3-a87d-1db3a0580e1a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.507675] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.610902] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9820df77-8912-404f-b55d-4187d2dd9605 [ 931.611354] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.611521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.611602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.611836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.612138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.612138] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9820df77-8912-404f-b55d-4187d2dd9605 already deleted. [ 931.612366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9820df77-8912-404f-b55d-4187d2dd9605" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.011975] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.013927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.013927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.013927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.013927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.013927] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 is going to be created. [ 932.057281] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.057457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.057670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.057739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.057900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.080852] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 in Status: UNINITIALIZED for 2s [ 932.927565] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8211522-f806-4e6b-bb2f-9669205024de in Status: SUCCESS [ 932.927995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.927995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.928252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.928446] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.928565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.928629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.928914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.928914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.929077] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8211522-f806-4e6b-bb2f-9669205024de',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.943475] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: SUCCESS [ 932.943788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.944281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.944500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.944685] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.944798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.944859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.945021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.945104] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.945202] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.435661] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.435661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.435661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.436632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.436632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.436632] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.436807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.436807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.437125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.437125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.437125] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8211522-f806-4e6b-bb2f-9669205024de is going to be deleted. [ 933.447353] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.490826] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.491036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.491493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.491493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.494501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.494501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.494501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.494501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.494501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.494501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.494501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.494501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.494501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.494501] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8211522-f806-4e6b-bb2f-9669205024de',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.806855] env[66854]: INFO networking_nsxv3.common.synchronization [req-07bf6780-d4f8-4466-ae38-c4f5e6eaaec0 req-50354150-3e66-4df4-88e4-4e814bbe0ce7 tempest-ListServerFiltersTestJSON-732493998 tempest-ListServerFiltersTestJSON-732493998-project-member] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 933.807441] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGHEST for action security_group_members [ 933.807825] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.809118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.809118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.809118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.809118] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.809118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.809118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.810995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.810995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.810995] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.951424] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.000155] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.000155] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.000155] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8211522-f806-4e6b-bb2f-9669205024de already deleted. [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.000155] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8211522-f806-4e6b-bb2f-9669205024de',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.000155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.000155] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.000718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.000718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.000718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.001138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.001674] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8211522-f806-4e6b-bb2f-9669205024de',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.104713] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 in Status: SUCCESS [ 934.104713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.104713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.104713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.104713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.104713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.104713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.104713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.104713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.104713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.104713] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.313802] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.314285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.314285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.314285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.314431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.314537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.314635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.314696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.315491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.315491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.315491] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be updated. [ 934.359337] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.360272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.360272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.360272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.360272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.383579] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: IN_PROGRESS for 2s [ 934.453316] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.455143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.455143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.455143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.455143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.455143] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 is going to be updated. [ 934.491300] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.491300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.491300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.491300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.491598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.508336] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: IN_PROGRESS for 2s [ 934.509338] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8211522-f806-4e6b-bb2f-9669205024de',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.513144] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.513144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.513144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.513144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.513144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.513144] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.513144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.513144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.513144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.513144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.514350] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8211522-f806-4e6b-bb2f-9669205024de already deleted. [ 934.514350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.610304] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.635857] env[66854]: INFO networking_nsxv3.common.synchronization [req-73bcf6d9-19b0-47d2-8751-81b1bc1ae919 req-97a98df5-74ba-4782-952f-f43de18a11da tempest-ImagesTestJSON-1862869845 tempest-ImagesTestJSON-1862869845-project-member] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 934.636244] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 934.636568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.636687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.636752] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.636985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.638298] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.639086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.639158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.639397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.639499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.639604] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.016979] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8211522-f806-4e6b-bb2f-9669205024de: rpc.has_security_group_logging(os_id): False [ 935.038665] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.038828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.038828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.039264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.039264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.039387] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.039491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.039548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.039684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.039790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.039901] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8211522-f806-4e6b-bb2f-9669205024de is going to be created. [ 935.067100] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e8211522-f806-4e6b-bb2f-9669205024de], does not exist path=[/infra/domains/default/groups/e8211522-f806-4e6b-bb2f-9669205024de]."\n}' [ 935.067930] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8211522-f806-4e6b-bb2f-9669205024de failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e8211522-f806-4e6b-bb2f-9669205024de [ 935.067930] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 935.111141] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.111330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.111386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.111747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.115051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.115561] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.115915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.115915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.116089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.116174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.116471] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.116653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.116770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.118954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.119157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.119321] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8211522-f806-4e6b-bb2f-9669205024de is going to be created. [ 935.121219] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da272d22-fe1c-4363-b694-0fd0d1bea6e5: rpc.has_security_group_logging(os_id): False [ 935.141979] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.142167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.142246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.142571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.194953] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.194953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.201114] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e8211522-f806-4e6b-bb2f-9669205024de], does not exist path=[/infra/domains/default/groups/e8211522-f806-4e6b-bb2f-9669205024de]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e8211522-f806-4e6b-bb2f-9669205024de [ 935.201351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8211522-f806-4e6b-bb2f-9669205024de" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.201874] env[66854]: Traceback (most recent call last): [ 935.201874] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 935.201874] env[66854]: return func(*args, **kwargs) [ 935.201874] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 935.201874] env[66854]: res.raise_for_status() [ 935.201874] env[66854]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 935.201874] env[66854]: raise HTTPError(http_error_msg, response=self) [ 935.201874] env[66854]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e8211522-f806-4e6b-bb2f-9669205024de [ 935.201874] env[66854]: During handling of the above exception, another exception occurred: [ 935.201874] env[66854]: Traceback (most recent call last): [ 935.201874] env[66854]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 935.201874] env[66854]: listener.cb(fileno) [ 935.201874] env[66854]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 935.201874] env[66854]: result = function(*args, **kwargs) [ 935.201874] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 935.201874] env[66854]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 935.201874] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 935.201874] env[66854]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 935.201874] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 935.201874] env[66854]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 935.201874] env[66854]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 935.201874] env[66854]: res.raise_for_status() [ 935.201874] env[66854]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 935.201874] env[66854]: raise HTTPError(http_error_msg, response=self) [ 935.201874] env[66854]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e8211522-f806-4e6b-bb2f-9669205024de [ 935.201874] env[66854]: Removing descriptor: 64 [ 935.203219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.203413] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.203556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.203627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.203949] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.204087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.204261] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 935.206124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.206331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.206579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.206984] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.207422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.207422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.207687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.207834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.208030] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 is going to be created. [ 935.258896] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.259255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.259626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.259626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.259881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.271189] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 935.298166] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.298457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.298457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.298730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.299022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.320130] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 in Status: IN_PROGRESS for 2s [ 935.799607] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb48ac23-a98f-417c-93f7-ec59d6d81f27 req-57f7bb16-d60c-4477-a0c2-0f745c413dfa tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 935.799992] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 935.800676] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.800676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.800676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.805211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.805211] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.805211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.805211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.805211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.805211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.805211] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.197999] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.198466] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.198466] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.199412] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.199412] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.199412] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.199614] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.200443] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.200443] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.200443] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 936.200443] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.200443] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.200670] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.200764] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 936.200837] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.200975] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.223758] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.224243] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 936.224423] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.224601] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.224925] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-a746c086-6737-49ed-a875-21af7f757ccb taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.225118] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-a746c086-6737-49ed-a875-21af7f757ccb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.225236] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-a746c086-6737-49ed-a875-21af7f757ccb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.225585] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-a746c086-6737-49ed-a875-21af7f757ccb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.225730] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a746c086-6737-49ed-a875-21af7f757ccb',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.310918] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.311098] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.311151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.311384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.369851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.369851] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.369851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.369851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.370179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.370179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.370234] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 936.393526] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1466949f-e84c-4398-88b8-456cc5ec401b in Status: SUCCESS [ 936.393769] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b deletion is rescheduled due to dependency. [ 936.393769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.402693] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.402693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.402693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.402693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.402693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.415519] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 936.521276] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: SUCCESS [ 936.521629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.521824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.522101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.522306] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.522427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.522495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.522704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.522807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.522846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.523009] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.525154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.525340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.525536] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.525647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.525726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.525861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.525944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.526066] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.729854] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.730109] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.730218] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.730530] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.730735] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.730948] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port a746c086-6737-49ed-a875-21af7f757ccb not found, creating... [ 936.731308] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.731505] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.731643] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.731979] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.732153] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.732503] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.732744] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.732903] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.733150] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.733288] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.733434] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: a746c086-6737-49ed-a875-21af7f757ccb is going to be created. [ 936.771735] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.772060] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.772297] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.772611] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.772885] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.773211] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-a746c086-6737-49ed-a875-21af7f757ccb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.028628] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.028841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.029033] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.290527] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 937.291063] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 deletion is rescheduled due to dependency. [ 937.291063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.365573] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 in Status: SUCCESS [ 937.365741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.531174] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.538278] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb48ac23-a98f-417c-93f7-ec59d6d81f27 req-ae4a7c64-d783-44de-88a3-7ec62a6c87b9 service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 937.538469] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb48ac23-a98f-417c-93f7-ec59d6d81f27 req-ae4a7c64-d783-44de-88a3-7ec62a6c87b9 service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 937.538617] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb48ac23-a98f-417c-93f7-ec59d6d81f27 req-ae4a7c64-d783-44de-88a3-7ec62a6c87b9 service nova] Enqueued Resource ID: a746c086-6737-49ed-a875-21af7f757ccb with Priority: HIGHEST for action port [ 937.539313] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 937.539454] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 937.539627] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a746c086-6737-49ed-a875-21af7f757ccb with Priority: HIGHEST for action port [ 937.540924] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.542032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.542032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.542032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.542032] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.544547] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.545409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.545409] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-a746c086-6737-49ed-a875-21af7f757ccb taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.545409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a746c086-6737-49ed-a875-21af7f757ccb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.545409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a746c086-6737-49ed-a875-21af7f757ccb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.545711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a746c086-6737-49ed-a875-21af7f757ccb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.545806] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a746c086-6737-49ed-a875-21af7f757ccb',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.034816] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.034816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.034816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.034816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.034816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.034816] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 is going to be updated. [ 938.050058] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.050058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.050058] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a746c086-6737-49ed-a875-21af7f757ccb with status ACTIVE [ 938.050058] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.050531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.050531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.050599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.050631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.050844] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.050951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.051050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.051729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.051729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.051729] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.051729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.051983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.052032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.052217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.052336] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a746c086-6737-49ed-a875-21af7f757ccb is going to be updated. [ 938.073486] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.073753] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.073753] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.074119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.074119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.081243] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.081243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.081243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.081243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.081243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.081243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a746c086-6737-49ed-a875-21af7f757ccb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.086262] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: IN_PROGRESS for 2s [ 938.375545] env[66854]: INFO networking_nsxv3.common.synchronization [req-a05ebe28-eaf7-4efc-8acf-e0b44f4ab0a6 req-482c693d-aa6f-42e3-927d-47276e863417 tempest-ListImageFiltersTestJSON-509701154 tempest-ListImageFiltersTestJSON-509701154-project-member] Enqueued Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 938.375913] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 938.376818] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.377100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.377100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.377376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.377666] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.377813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.377902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.378119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.378214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.378335] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.433796] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 938.434149] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 938.434149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.434286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.434516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.434706] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.434819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.435045] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.435045] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.435132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.435281] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.466954] env[66854]: INFO networking_nsxv3.common.synchronization [req-5d3aef2c-831b-4fd8-b7d9-634225834509 req-6e80968e-1096-400f-9fa6-0638f0511596 tempest-ServerRescueTestJSONUnderV235-951130903 tempest-ServerRescueTestJSONUnderV235-951130903-project-member] Enqueued Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 938.467537] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803ac34f-a70c-44ba-9693-3e4cba201877 with Priority: HIGHEST for action security_group_members [ 938.467900] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.468140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.752740] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.752949] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.753163] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.753444] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.753720] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.753878] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.753999] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.754249] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.754394] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.754606] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.754722] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.754833] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.754946] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.755068] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.755177] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.755309] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.777560] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.777672] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 938.777816] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.778226] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.778561] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.778734] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.778855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.779195] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.779340] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.881145] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.881145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.881145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.881145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.881145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.881145] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.881481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.881481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.881481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.882820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.883138] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c84b2-3881-420f-8626-4994a562540b already deleted. [ 938.883333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.938153] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.281736] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.282054] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.282198] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.282488] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.282637] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.282789] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7 not found, creating... [ 939.283112] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.283282] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.283409] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.283622] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.283772] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.284301] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.284498] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.284616] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.284825] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.284972] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.285132] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7 is going to be created. [ 939.309936] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.310334] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.310551] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.310971] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.311500] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.311886] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.441522] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.781966] env[66854]: INFO networking_nsxv3.common.synchronization [req-9c627867-797d-4257-8239-84b9272c9a58 req-533ada69-8f37-49a3-9f6c-6a559734c767 tempest-MigrationsAdminTest-1593966740 tempest-MigrationsAdminTest-1593966740-project-member] Enqueued Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 939.783398] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 939.784546] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.784546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.784546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.784546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.784802] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.784802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.784894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.785912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.785912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.785912] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.945594] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.945726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.945799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.946208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.946338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.946817] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 939.997767] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.997767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.999319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.999319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.999319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.022138] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 940.066299] env[66854]: INFO networking_nsxv3.common.synchronization [req-a05ebe28-eaf7-4efc-8acf-e0b44f4ab0a6 req-d167d536-4c83-4a8e-a572-249c00f2aa9d service nova] Enqueued Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_rules [ 940.066299] env[66854]: INFO networking_nsxv3.common.synchronization [req-a05ebe28-eaf7-4efc-8acf-e0b44f4ab0a6 req-d167d536-4c83-4a8e-a572-249c00f2aa9d service nova] Enqueued Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 940.066299] env[66854]: INFO networking_nsxv3.common.synchronization [req-a05ebe28-eaf7-4efc-8acf-e0b44f4ab0a6 req-d167d536-4c83-4a8e-a572-249c00f2aa9d service nova] Enqueued Resource ID: c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7 with Priority: HIGHEST for action port [ 940.068289] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_rules [ 940.068289] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 940.068289] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7 with Priority: HIGHEST for action port [ 940.068289] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.068662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.068926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.069290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.069462] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.071655] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.071925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.072151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.072491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.073450] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.073797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.073984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.074273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.074451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.074668] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.075784] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.079348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.079440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.079659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.079745] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.098791] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: SUCCESS [ 940.098963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.099080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.099327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.099522] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.100452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.100452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.100452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.100452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.100452] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.288624] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.572906] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.572906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.585225] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.585225] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7 with status ACTIVE [ 940.585225] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.585225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.585225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.585225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.585225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.585225] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.585225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.585225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.585225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.585946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.586318] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.586739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.586909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.587190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.587361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.587526] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7 is going to be updated. [ 940.604762] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.605993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.606278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.606534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.624953] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.625110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.625182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.625407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.627675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.627675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8df1ae6-abaa-4a3c-ab1a-87a8e3843bf7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.631912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.632503] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.632637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.632699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.632952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.633067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.633710] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 is going to be updated. [ 940.684429] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.684647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.684710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.685086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.685244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.706972] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: IN_PROGRESS for 2s [ 940.792092] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.890959] env[66854]: INFO networking_nsxv3.common.synchronization [req-cc6d0261-ae23-4870-92e3-f9922e8f29cb req-850f5cd3-2d25-4553-902c-6862ca6dee2b tempest-ListImageFiltersTestJSON-509701154 tempest-ListImageFiltersTestJSON-509701154-project-member] Enqueued Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 940.891653] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 940.891865] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.891988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.090388] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.225841] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.226074] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.226213] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.226486] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.226763] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.226923] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.227063] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.227296] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.227445] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.227670] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.227799] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.227910] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.228048] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.228189] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.228589] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.228589] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.248454] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.248673] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 941.248847] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.249072] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.249439] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-f6e46e09-7162-45a5-977c-fa2700261614 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.249661] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-f6e46e09-7162-45a5-977c-fa2700261614" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.249850] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-f6e46e09-7162-45a5-977c-fa2700261614" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.250260] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-f6e46e09-7162-45a5-977c-fa2700261614" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.250454] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6e46e09-7162-45a5-977c-fa2700261614',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.295640] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.295801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.295864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.296243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.296388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.296523] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 is going to be updated. [ 941.359031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.359031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.359031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.359031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.361154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.375383] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: IN_PROGRESS for 2s [ 941.594153] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.594584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.594584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.594707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.594786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.594914] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c84b2-3881-420f-8626-4994a562540b is going to be created. [ 941.624236] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.624964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.624964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.624964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.625235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.641682] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: UNINITIALIZED for 2s [ 941.753462] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.753462] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.753592] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.753974] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.754148] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.754306] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port f6e46e09-7162-45a5-977c-fa2700261614 not found, creating... [ 941.754570] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.754724] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.754840] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.755071] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.755214] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.755500] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.755636] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.755751] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.755957] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.756100] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.756256] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: f6e46e09-7162-45a5-977c-fa2700261614 is going to be created. [ 941.782372] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.782633] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.782760] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.783070] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.783308] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.783533] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-f6e46e09-7162-45a5-977c-fa2700261614" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.037193] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 942.037419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.037597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.037826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.038036] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.038159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.038226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.038381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.038461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.038545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.038638] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.540672] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.542020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.542020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.542020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.542020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.542020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.542020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.542372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.542372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.542553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.542811] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.542966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.543634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.543634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.543634] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.543792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.543907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.544153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.545056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.545056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.545056] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.562860] env[66854]: INFO networking_nsxv3.common.synchronization [req-cc6d0261-ae23-4870-92e3-f9922e8f29cb req-316b80f1-282b-4a43-8db5-ea62b20661f3 service nova] Enqueued Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_rules [ 942.563191] env[66854]: INFO networking_nsxv3.common.synchronization [req-cc6d0261-ae23-4870-92e3-f9922e8f29cb req-316b80f1-282b-4a43-8db5-ea62b20661f3 service nova] Enqueued Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 942.563413] env[66854]: INFO networking_nsxv3.common.synchronization [req-cc6d0261-ae23-4870-92e3-f9922e8f29cb req-316b80f1-282b-4a43-8db5-ea62b20661f3 service nova] Enqueued Resource ID: f6e46e09-7162-45a5-977c-fa2700261614 with Priority: HIGHEST for action port [ 942.564565] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_rules [ 942.564718] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 942.564828] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6e46e09-7162-45a5-977c-fa2700261614 with Priority: HIGHEST for action port [ 942.565597] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.565597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.565597] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.565597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.565859] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6e46e09-7162-45a5-977c-fa2700261614 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.565859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6e46e09-7162-45a5-977c-fa2700261614" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.565947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6e46e09-7162-45a5-977c-fa2700261614" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.566128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6e46e09-7162-45a5-977c-fa2700261614" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.566215] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6e46e09-7162-45a5-977c-fa2700261614',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.717448] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: SUCCESS [ 942.717804] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 deletion is rescheduled due to dependency. [ 942.717804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.717948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.718187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.718390] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.718509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.718575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.718734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.718817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.718906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.719089] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-803ac34f-a70c-44ba-9693-3e4cba201877 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.719193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.719296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.719518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.719694] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.719798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.719859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.720016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.720096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.720217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.720312] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.721496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.721673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.721825] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.721929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.721988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.722178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.722296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.722345] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.047423] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab5dfec-4c69-486f-983d-2ea9413eccfa: rpc.has_security_group_logging(os_id): False [ 943.068587] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6e46e09-7162-45a5-977c-fa2700261614 with status ACTIVE [ 943.068823] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.068967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.069058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.069271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.069368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.069557] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.069658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.069715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.069874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.069984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.070159] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.070257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.070304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.070434] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.070511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.070595] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6e46e09-7162-45a5-977c-fa2700261614 is going to be updated. [ 943.072630] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.072718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.072718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.072891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.072992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.073227] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.073380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.073461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.074076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.074209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.074439] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.074544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.074624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.074780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.074859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.075080] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.075194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.075264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.075423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.075505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.075593] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 943.103759] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.103759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.104327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.104327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.104327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.104477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6e46e09-7162-45a5-977c-fa2700261614" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.150666] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.150894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.150961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.151163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.151346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.180296] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 943.224504] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 803ac34f-a70c-44ba-9693-3e4cba201877: rpc.has_security_group_logging(os_id): False [ 943.225565] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.225700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.225903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.225965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.226096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.227202] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.227202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.227202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.227202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.227202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.227202] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 is going to be updated. [ 943.251084] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.251247] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.251322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.251680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.251717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.251902] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.252053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.252963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.252963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.252963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.252963] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.252963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.252963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.253309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.253309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.253407] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.253500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.253558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.253698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.253771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.253854] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 is going to be updated. [ 943.305034] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.305243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.305296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.305588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.305912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.316026] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: IN_PROGRESS for 2s [ 943.374420] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.374420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.374420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.374804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.374804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.385934] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: SUCCESS [ 943.386141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.393254] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: IN_PROGRESS for 2s [ 943.516693] env[66854]: INFO networking_nsxv3.common.synchronization [req-38230651-29b4-4024-b3ec-970145de76da req-bb7021ac-edf1-48e5-b860-947eb83a0367 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 943.517358] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 943.517797] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.517970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.518264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.518336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.518518] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.518630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.518714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.518924] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.519034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.519140] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.653109] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: SUCCESS [ 943.653327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.653892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.654124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.654325] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.654711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.654782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.654972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.655032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.655115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.655224] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.656042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.656209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.656369] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.656469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.657186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.657186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.657186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.657186] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.901858] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.902208] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.902208] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.902512] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.902773] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.902931] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.903116] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.903357] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.903510] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.903719] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.903830] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.903939] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.904058] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.904169] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.904274] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.904753] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.931586] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.931777] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.931923] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.932112] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.932503] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-aad37384-c1f6-43b0-ba3b-fcb7b44c12c6 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.932679] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-aad37384-c1f6-43b0-ba3b-fcb7b44c12c6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.932809] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-aad37384-c1f6-43b0-ba3b-fcb7b44c12c6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.933192] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-aad37384-c1f6-43b0-ba3b-fcb7b44c12c6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.933345] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad37384-c1f6-43b0-ba3b-fcb7b44c12c6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.022196] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.022531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.022531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.022682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.051394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.051640] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.051772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.051837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.052024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.052105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.053041] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 944.084702] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.084853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.084925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.085164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.085308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.096325] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 944.158974] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.159168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.159338] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.435653] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.435950] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.436107] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.436352] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.436524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.436703] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port aad37384-c1f6-43b0-ba3b-fcb7b44c12c6 not found, creating... [ 944.436983] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.437723] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.437723] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.437723] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.437723] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.438033] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.438143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.438264] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.438853] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.438853] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.438853] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: aad37384-c1f6-43b0-ba3b-fcb7b44c12c6 is going to be created. [ 944.482606] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.482826] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.482954] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.483299] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.483524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.483764] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-aad37384-c1f6-43b0-ba3b-fcb7b44c12c6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.662223] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.165298] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.165682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.165682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.165836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.165952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.166094] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c84b2-3881-420f-8626-4994a562540b is going to be updated. [ 945.186882] env[66854]: INFO networking_nsxv3.common.synchronization [req-38230651-29b4-4024-b3ec-970145de76da req-0ab7c22e-5f5f-44dc-8cfa-7ebfbd48d4c0 service nova] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_rules [ 945.186882] env[66854]: INFO networking_nsxv3.common.synchronization [req-38230651-29b4-4024-b3ec-970145de76da req-0ab7c22e-5f5f-44dc-8cfa-7ebfbd48d4c0 service nova] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 945.187294] env[66854]: INFO networking_nsxv3.common.synchronization [req-38230651-29b4-4024-b3ec-970145de76da req-0ab7c22e-5f5f-44dc-8cfa-7ebfbd48d4c0 service nova] Enqueued Resource ID: aad37384-c1f6-43b0-ba3b-fcb7b44c12c6 with Priority: HIGHEST for action port [ 945.191971] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_rules [ 945.191971] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 945.191971] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aad37384-c1f6-43b0-ba3b-fcb7b44c12c6 with Priority: HIGHEST for action port [ 945.191971] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.191971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.191971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.191971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.191971] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.191971] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.191971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.192802] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-aad37384-c1f6-43b0-ba3b-fcb7b44c12c6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.192802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aad37384-c1f6-43b0-ba3b-fcb7b44c12c6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.192802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aad37384-c1f6-43b0-ba3b-fcb7b44c12c6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.193101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aad37384-c1f6-43b0-ba3b-fcb7b44c12c6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.193101] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad37384-c1f6-43b0-ba3b-fcb7b44c12c6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.205985] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.205985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.205985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.205985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.205985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.205985] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 945.205985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.215276] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: IN_PROGRESS for 2s [ 945.331532] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: SUCCESS [ 945.331803] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 deletion is rescheduled due to dependency. [ 945.331870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.413042] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 803ac34f-a70c-44ba-9693-3e4cba201877 in Status: SUCCESS [ 945.413244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.413557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.413706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.413765] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('803ac34f-a70c-44ba-9693-3e4cba201877',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.696511] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.696648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.696834] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aad37384-c1f6-43b0-ba3b-fcb7b44c12c6 with status ACTIVE [ 945.697018] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.697129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.697194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.697406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.697497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.697673] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.697770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.697832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.697981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.698069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.698252] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.698348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.698408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.698682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.698761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.698849] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aad37384-c1f6-43b0-ba3b-fcb7b44c12c6 is going to be updated. [ 945.723431] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.723673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.723673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.723937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.724107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.724279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aad37384-c1f6-43b0-ba3b-fcb7b44c12c6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.936266] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.936549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.936549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.936824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.936917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.937036] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 803ac34f-a70c-44ba-9693-3e4cba201877 is going to be deleted. [ 945.991442] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.991655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.991699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.992081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.992081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.992198] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-803ac34f-a70c-44ba-9693-3e4cba201877" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.113410] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 946.113586] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 deletion is rescheduled due to dependency. [ 946.113703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.113867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.114122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.114317] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.114516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.114587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.114757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.114856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.114960] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.617556] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.120371] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.227039] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: SUCCESS [ 947.227411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.227665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.228661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.229356] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.229976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.229976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.229976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.230649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.230649] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.622767] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.623157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.623157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.623399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.623399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.623487] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 947.666246] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.666461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.666553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.666824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.666991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.676560] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 947.733501] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.972621] env[66854]: INFO networking_nsxv3.common.synchronization [req-cef4ba94-2589-47bb-9079-3c7a1a1c0072 req-1aa6ee4f-e89e-4886-b79d-ac336ed83f56 tempest-ServersAdminTestJSON-1278843131 tempest-ServersAdminTestJSON-1278843131-project-member] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 947.973977] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGHEST for action security_group_members [ 947.973977] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.973977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.973977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.974313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.974502] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.974627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.974672] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.974838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.974931] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.975110] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.237987] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.480447] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.480447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.480447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.480447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.503459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.503902] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.504080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.504155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.504371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.504459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.504553] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be updated. [ 948.543928] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.543928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.543928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.544109] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.544140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.560781] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: IN_PROGRESS for 2s [ 948.744753] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.745324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.745324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.745963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.745963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.745963] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c84b2-3881-420f-8626-4994a562540b is going to be updated. [ 948.792961] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.792961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.792961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.793276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.793459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.804794] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: IN_PROGRESS for 2s [ 949.688281] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 949.688565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.688809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.689977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.689977] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.689977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.689977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.689977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.689977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.689977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.689977] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.895867] env[66854]: INFO networking_nsxv3.common.synchronization [req-9a392c0c-6321-40cc-9b8c-05bc7c3bfd26 req-8ad5bedc-edf8-4c7f-a268-7567bea6cd47 tempest-AttachVolumeTestJSON-1641278713 tempest-AttachVolumeTestJSON-1641278713-project-member] Enqueued Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_members [ 949.896576] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGHEST for action security_group_members [ 949.896911] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.897021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.897311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.897524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.897691] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.898152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.898260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.898469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.898738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.898865] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.198661] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.198661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.198661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.198971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.199141] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.199320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.199372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.199554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.201203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.201203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.201203] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.201203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.201203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.201203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.201203] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.201203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.201203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.201203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.201203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.201203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.201203] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.401728] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.401948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.402026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.402268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.427747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.428085] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.428210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.428378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.428454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.428520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.428588] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 is going to be updated. [ 950.498645] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.499140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.499140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.499316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.499478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.514098] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 in Status: IN_PROGRESS for 2s [ 950.571468] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c in Status: SUCCESS [ 950.571690] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c deletion is rescheduled due to dependency. [ 950.571810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.704376] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ccc5a4-8c8a-445b-b37a-462c691c3639: rpc.has_security_group_logging(os_id): False [ 950.723724] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.723973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.724051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.724261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.724356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.724560] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.724661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.724727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.724880] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.724958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.725171] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.725268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.725333] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.725475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.725550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.725741] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.725835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.725899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.726052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.726129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.726223] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 950.788708] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.788915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.788915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.789164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.789312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.801257] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 950.816787] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: SUCCESS [ 950.816979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.816979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.817238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.817444] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.817566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.817638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.817785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.817860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.817950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.818118] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.818217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.818276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.818401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.818540] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.818631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.818700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.818817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.818891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.818973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.819076] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.321717] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 058c84b2-3881-420f-8626-4994a562540b: rpc.has_security_group_logging(os_id): False [ 951.356194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.357218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.357218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.357431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.357565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.357783] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.357905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.358712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.358712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.358712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.358712] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.358712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.358712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.358952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.358952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.359343] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.359343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.359343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.359343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.359494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.359494] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 058c84b2-3881-420f-8626-4994a562540b is going to be created. [ 951.434475] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.434636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.434677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.434884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.435101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.447342] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: IN_PROGRESS for 2s [ 952.524835] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 in Status: SUCCESS [ 952.525239] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 deletion is rescheduled due to dependency. [ 952.525239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.836390] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 952.836771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.461396] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: SUCCESS [ 953.461677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.461917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.465623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.465880] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.968297] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.968756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.968756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.968756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.968934] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.968934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.968934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.969177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.969177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.969279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.969334] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.473862] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.473862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.473862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.473862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.474128] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.474194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.474510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.474734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.474853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.474981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.475199] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.476323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.476323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.476323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.476323] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.476323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.476323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.476323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.476323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.476323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.476814] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.895399] env[66854]: INFO networking_nsxv3.common.synchronization [req-de067d3c-19df-4b37-af5b-8509778c3a40 req-4c9ee4cb-02f1-4f0c-b868-aa8313e5192a tempest-ServersNegativeTestJSON-789183655 tempest-ServersNegativeTestJSON-789183655-project-member] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 954.895882] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 954.896467] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.896639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.896745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.897081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.897313] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.897461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.897543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.898029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.898029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.898029] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.980657] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 058c84b2-3881-420f-8626-4994a562540b: rpc.has_security_group_logging(os_id): False [ 955.004539] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.008033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.008033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.008033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.008033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.008033] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.008033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.008033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.008033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.008033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.008838] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.008838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.009377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.009377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.009377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.010084] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.010259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.010340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.011697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.011806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.011885] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 058c84b2-3881-420f-8626-4994a562540b is going to be updated. [ 955.097254] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.097530] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.097530] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.098384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.098597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.112284] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: IN_PROGRESS for 2s [ 955.392629] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-643 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.392795] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.392919] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.396278] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.396278] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.396278] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.396278] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.396538] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.397154] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.397154] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.397154] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.397154] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.397154] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.397348] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.397377] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.397513] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.400878] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.401582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.401582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.401582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.401582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.401895] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.402098] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.402217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.402429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.402551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.402884] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 already deleted. [ 955.402884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.419954] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.420238] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 955.420365] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.420645] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.421055] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.421283] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.421427] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.421756] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.421928] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b46a84b6-1de9-49b4-a95f-0fe1f4df28e7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.927753] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.928162] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.928411] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.928872] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.929138] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.929417] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 not found, creating... [ 955.929869] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.930198] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.930361] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.930735] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.930969] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.931630] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.931769] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.931943] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.932339] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.932574] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.932829] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 is going to be created. [ 955.962108] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.962410] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.962557] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.962908] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.963171] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.963563] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.676034] env[66854]: INFO networking_nsxv3.common.synchronization [req-de067d3c-19df-4b37-af5b-8509778c3a40 req-2c0ce457-c0d7-4f06-abb1-a6928ddf31cd service nova] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_rules [ 956.676034] env[66854]: INFO networking_nsxv3.common.synchronization [req-de067d3c-19df-4b37-af5b-8509778c3a40 req-2c0ce457-c0d7-4f06-abb1-a6928ddf31cd service nova] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 956.676034] env[66854]: INFO networking_nsxv3.common.synchronization [req-de067d3c-19df-4b37-af5b-8509778c3a40 req-2c0ce457-c0d7-4f06-abb1-a6928ddf31cd service nova] Enqueued Resource ID: b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 with Priority: HIGHEST for action port [ 956.676034] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_rules [ 956.676034] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 956.676034] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 with Priority: HIGHEST for action port [ 956.676034] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.676034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.676034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.676034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.676034] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.676034] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.676034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.676034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.676034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.676788] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.676788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.676788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.676788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.676788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.676788] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.678292] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.678399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.678462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.678709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.678751] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b46a84b6-1de9-49b4-a95f-0fe1f4df28e7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.129842] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: SUCCESS [ 957.129842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.181835] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.181835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.181835] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.182771] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 with status ACTIVE [ 957.182960] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.183079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.183150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.183361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.183506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.183692] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.183792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.183854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.184042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.184125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.184329] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.184423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.184538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.184649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.184714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.184793] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 is going to be updated. [ 957.213645] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.213815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.214224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.214948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.214948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.215746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.687445] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.191619] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.192341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.192341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.192440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.192485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.193323] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 is going to be created. [ 958.232920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.233206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.233278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.233640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.234341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.250729] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: UNINITIALIZED for 2s [ 959.270954] env[66854]: INFO networking_nsxv3.common.synchronization [req-83e7b745-576f-4a3e-b10e-da29471a4175 req-4c9bbc7d-63b7-4f16-8e91-1e1c669dc133 tempest-ImagesTestJSON-1862869845 tempest-ImagesTestJSON-1862869845-project-member] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 959.271682] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 959.274019] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.274895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.275049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.275293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.275862] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.275862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.275862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.275862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.276065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.276065] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.781363] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.782042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.782042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.782844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.782844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.782957] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.783195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.783321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.783659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.784729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.784729] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 959.798754] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.799289] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.799289] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.799405] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.800129] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.800129] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.800129] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.800394] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.800394] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.800614] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.800723] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.800862] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.800973] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.801104] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.801211] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.801345] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.822627] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.822832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.822879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.823078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.823227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.825379] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.825538] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.825678] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.825859] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.826416] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-f65180bb-f510-4d64-8dbe-7380db307ac1 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.826416] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-f65180bb-f510-4d64-8dbe-7380db307ac1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.826711] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-f65180bb-f510-4d64-8dbe-7380db307ac1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.826832] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-f65180bb-f510-4d64-8dbe-7380db307ac1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.826972] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f65180bb-f510-4d64-8dbe-7380db307ac1',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.839219] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 959.894021] env[66854]: INFO networking_nsxv3.common.synchronization [None req-0077bb17-c69e-482c-bee9-5ea392c002f2 None None] Enqueued Resource ID: 2be3f586-f519-4748-8a59-0d00e3550511 with Priority: HIGHEST for action port [ 959.894021] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2be3f586-f519-4748-8a59-0d00e3550511 with Priority: HIGHEST for action port [ 959.894021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-2be3f586-f519-4748-8a59-0d00e3550511 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.894312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2be3f586-f519-4748-8a59-0d00e3550511" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.894494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2be3f586-f519-4748-8a59-0d00e3550511" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.894888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2be3f586-f519-4748-8a59-0d00e3550511" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.896316] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2be3f586-f519-4748-8a59-0d00e3550511',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.263501] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: SUCCESS [ 960.263883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.265028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.265028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.265028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.265028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.265028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.265028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.265363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.265363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.265363] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.332584] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.332967] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.333095] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.333479] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.333758] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.333954] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port f65180bb-f510-4d64-8dbe-7380db307ac1 not found, creating... [ 960.334368] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.335434] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.335434] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.335915] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.335915] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.336092] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.336275] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.336400] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.336661] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.336801] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.336951] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: f65180bb-f510-4d64-8dbe-7380db307ac1 is going to be created. [ 960.367894] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.368144] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.368306] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.368637] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.368919] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.369137] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-f65180bb-f510-4d64-8dbe-7380db307ac1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.398924] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2be3f586-f519-4748-8a59-0d00e3550511 [ 960.399354] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.399567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.399664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.399933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.400072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.400188] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2be3f586-f519-4748-8a59-0d00e3550511 already deleted. [ 960.400298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2be3f586-f519-4748-8a59-0d00e3550511" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.767868] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.768070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.768188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.768517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.770826] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.770826] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.770826] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.770826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.771442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.771442] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.895230] env[66854]: INFO networking_nsxv3.common.synchronization [req-77080989-be17-45f9-b427-80420759f958 req-922528fd-8a0d-40ae-9de8-f0ed12c8ceb6 tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 960.898055] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 960.898055] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.898055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.898055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.898055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.898055] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.898055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.898055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.898055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.898055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.898055] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.105447] env[66854]: INFO networking_nsxv3.common.synchronization [req-83e7b745-576f-4a3e-b10e-da29471a4175 req-5d9f8f10-6879-4aba-ab37-efc697c90c2a service nova] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_rules [ 961.105879] env[66854]: INFO networking_nsxv3.common.synchronization [req-83e7b745-576f-4a3e-b10e-da29471a4175 req-5d9f8f10-6879-4aba-ab37-efc697c90c2a service nova] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 961.106042] env[66854]: INFO networking_nsxv3.common.synchronization [req-83e7b745-576f-4a3e-b10e-da29471a4175 req-5d9f8f10-6879-4aba-ab37-efc697c90c2a service nova] Enqueued Resource ID: f65180bb-f510-4d64-8dbe-7380db307ac1 with Priority: HIGHEST for action port [ 961.106751] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_rules [ 961.106853] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 961.106999] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65180bb-f510-4d64-8dbe-7380db307ac1 with Priority: HIGHEST for action port [ 961.108385] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.108385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.108385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.108385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.108385] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.108853] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.108963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.110414] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f65180bb-f510-4d64-8dbe-7380db307ac1 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.110571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f65180bb-f510-4d64-8dbe-7380db307ac1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.110647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f65180bb-f510-4d64-8dbe-7380db307ac1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.110850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f65180bb-f510-4d64-8dbe-7380db307ac1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.110936] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f65180bb-f510-4d64-8dbe-7380db307ac1',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.274372] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a12683d9-3f0c-4d0e-adac-f42cb41ab395: rpc.has_security_group_logging(os_id): False [ 961.294697] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.294923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.295063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.295269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.295365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.295635] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.295740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.295802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.296033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.296168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.296455] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.296559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.296652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.296807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.296911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.297121] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.297215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.297281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.297487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.297561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.297654] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 is going to be created. [ 961.369944] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.369944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.370620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.370620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.370620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.384097] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: IN_PROGRESS for 2s [ 961.401309] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.401456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.401510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.401751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.401970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.402278] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.402387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.402522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.402668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.402756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.402840] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 961.440596] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.440814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.440882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.441177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.441377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.461961] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 961.613702] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.613941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.614225] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f65180bb-f510-4d64-8dbe-7380db307ac1 with status ACTIVE [ 961.614509] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.614636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.614713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.615075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.615215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.616345] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.616345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.616345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.616345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.616573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.616698] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.616789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.616895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.617216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.617216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.617287] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f65180bb-f510-4d64-8dbe-7380db307ac1 is going to be updated. [ 961.647894] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.648175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.648299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.648611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.648779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.649022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f65180bb-f510-4d64-8dbe-7380db307ac1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.854778] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 961.855060] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 deletion is rescheduled due to dependency. [ 961.855188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.855366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.855589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.855778] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.855891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.855955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.856127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.856206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.856306] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.360659] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.464093] env[66854]: INFO networking_nsxv3.common.synchronization [None req-1cf1de0f-a5ae-441f-b510-1ef93f890121 None None] Enqueued Resource ID: e527721c-674a-4719-ac13-e9921c7c340a with Priority: HIGHEST for action port [ 962.464634] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e527721c-674a-4719-ac13-e9921c7c340a with Priority: HIGHEST for action port [ 962.465295] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e527721c-674a-4719-ac13-e9921c7c340a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.465295] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e527721c-674a-4719-ac13-e9921c7c340a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.465406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e527721c-674a-4719-ac13-e9921c7c340a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.465696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e527721c-674a-4719-ac13-e9921c7c340a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.465794] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e527721c-674a-4719-ac13-e9921c7c340a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.864353] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.968227] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e527721c-674a-4719-ac13-e9921c7c340a [ 962.971071] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.971071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.971071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.971071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.971071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.971071] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e527721c-674a-4719-ac13-e9921c7c340a already deleted. [ 962.971071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e527721c-674a-4719-ac13-e9921c7c340a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.368657] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.368657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.368775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.370339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.370339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.370339] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 963.408115] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: SUCCESS [ 963.408419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.414379] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.414496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.414576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.414781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.414934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.426571] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 963.472775] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 963.472775] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 963.472775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.986482] env[66854]: INFO networking_nsxv3.common.synchronization [req-c175f79f-a56b-4c63-b0ad-eeb99d34a9e5 req-a5cf85fd-eb99-40e7-ba70-59115c2f328c tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 963.987052] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 963.987370] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.987494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.987562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.987764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.987919] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.988100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.988184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.988323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.988430] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.988555] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.412961] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-541 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.413420] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.413702] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.414194] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.414485] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.414738] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.414826] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.415121] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.415275] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.415519] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.415700] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.415840] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.415973] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.416080] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.416190] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.416399] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.440122] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.440122] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 964.440122] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.440374] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.440881] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-dc866923-9958-4ea2-a00d-225f13c6aa64 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.441143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-dc866923-9958-4ea2-a00d-225f13c6aa64" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.441330] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-dc866923-9958-4ea2-a00d-225f13c6aa64" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.441800] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-dc866923-9958-4ea2-a00d-225f13c6aa64" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.442048] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc866923-9958-4ea2-a00d-225f13c6aa64',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.491105] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.947044] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.947418] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.947608] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.948019] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.948678] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.948678] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port dc866923-9958-4ea2-a00d-225f13c6aa64 not found, creating... [ 964.949118] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.949334] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.949510] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.949816] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.950082] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.950896] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.950896] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.950896] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.951143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.951143] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.951297] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: dc866923-9958-4ea2-a00d-225f13c6aa64 is going to be created. [ 964.973976] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.974678] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.974678] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.975043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.975043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.976957] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-dc866923-9958-4ea2-a00d-225f13c6aa64" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.994663] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.447441] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 965.447736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.447880] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.448138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.448346] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.448466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.448523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.448710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.448788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.448882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.448979] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.499843] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.500209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.500209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.500510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.500510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.500510] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 965.534786] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.534920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.534971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.535213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.535375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.545193] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 965.749804] env[66854]: INFO networking_nsxv3.common.synchronization [req-c175f79f-a56b-4c63-b0ad-eeb99d34a9e5 req-266b4958-e5ff-4257-8152-170bce842fc8 service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 965.749986] env[66854]: INFO networking_nsxv3.common.synchronization [req-c175f79f-a56b-4c63-b0ad-eeb99d34a9e5 req-266b4958-e5ff-4257-8152-170bce842fc8 service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 965.750140] env[66854]: INFO networking_nsxv3.common.synchronization [req-c175f79f-a56b-4c63-b0ad-eeb99d34a9e5 req-266b4958-e5ff-4257-8152-170bce842fc8 service nova] Enqueued Resource ID: dc866923-9958-4ea2-a00d-225f13c6aa64 with Priority: HIGHEST for action port [ 965.750672] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 965.750828] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 965.750930] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc866923-9958-4ea2-a00d-225f13c6aa64 with Priority: HIGHEST for action port [ 965.751219] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.751341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.751451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.751601] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.751680] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.752532] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.752657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.752812] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc866923-9958-4ea2-a00d-225f13c6aa64 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.752909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc866923-9958-4ea2-a00d-225f13c6aa64" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.752960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc866923-9958-4ea2-a00d-225f13c6aa64" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.753142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc866923-9958-4ea2-a00d-225f13c6aa64" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.753215] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc866923-9958-4ea2-a00d-225f13c6aa64',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.952814] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.953166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.953229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.953457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.953754] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.953900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.953968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.954179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.954352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.954527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.954721] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.954809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.954919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.955101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.955586] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.955688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.955765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.956042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.956177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.956289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.956396] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.254664] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.254858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.255041] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc866923-9958-4ea2-a00d-225f13c6aa64 with status ACTIVE [ 966.255261] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.255409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.255455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.257177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.257177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.257177] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.257177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.257177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.257177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.257177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.257177] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.257177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.257177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.257177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.257177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.257689] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc866923-9958-4ea2-a00d-225f13c6aa64 is going to be updated. [ 966.283329] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.283329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.283329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.283476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.283509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.283956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc866923-9958-4ea2-a00d-225f13c6aa64" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.460045] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44b9fe7e-d139-4b46-925d-7947b4b3dac9: rpc.has_security_group_logging(os_id): False [ 966.481752] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.481930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.481995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.482269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.482389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.482621] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.482741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.482828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.483034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.483134] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.483360] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.483485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.483554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.483728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.483850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.484105] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.484241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.484338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.484533] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.484655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.484769] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 966.569717] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.569999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.569999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.570568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.570568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.583642] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 967.558402] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 967.558663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.558864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.559171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.559403] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.559529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.559671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.559860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.559960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.560080] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.063367] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.565887] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.602269] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 968.603394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.068753] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.069121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.069121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.069222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.069800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.069800] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 969.114845] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.115053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.115134] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.116634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.116897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.131629] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 969.445384] env[66854]: INFO networking_nsxv3.common.synchronization [req-54a64fa3-685a-41c2-99fc-4b2ffa09c878 req-e11d2186-5999-421b-9798-fce4fa000e74 tempest-MigrationsAdminTest-1593966740 tempest-MigrationsAdminTest-1593966740-project-member] Enqueued Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 969.446542] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGHEST for action security_group_members [ 969.446661] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.446720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.446918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.447487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.447487] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.447487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.447487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.447653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.447685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.447788] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.950488] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.950660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.950766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.950929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.973945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.974050] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.974174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.974240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.974470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.974556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.974711] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 is going to be updated. [ 970.010251] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.010430] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.010536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.010714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.010868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.022232] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: IN_PROGRESS for 2s [ 970.797098] env[66854]: INFO networking_nsxv3.common.synchronization [req-b30d4d3d-ae6a-460a-ad29-a0aad5202ff6 req-81feff66-2803-4bb7-a5c2-947b9357af66 tempest-ImagesOneServerNegativeTestJSON-1585579513 tempest-ImagesOneServerNegativeTestJSON-1585579513-project-member] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 970.797098] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 970.797098] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.797545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.797545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.797697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.798372] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.798559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.798674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.799023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.799358] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.799358] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.145525] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 971.146122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.146772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.147072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.147876] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.148338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.148565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.149216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.149216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.149216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.149470] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.302481] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.302928] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.303033] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.303261] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.303543] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.303705] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.303826] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.304062] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.304206] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.304419] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.304552] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.304635] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.304756] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.304881] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.304986] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.305476] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.306637] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.306768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.306824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.307009] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.335374] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.335569] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.335742] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.335936] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-520" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.336495] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-3b13b015-f932-4599-9d17-1fcca6b95438 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.336693] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-3b13b015-f932-4599-9d17-1fcca6b95438" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.336816] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-3b13b015-f932-4599-9d17-1fcca6b95438" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.337271] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-3b13b015-f932-4599-9d17-1fcca6b95438" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.337433] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b13b015-f932-4599-9d17-1fcca6b95438',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.350108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.350426] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.350577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.350654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.350864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.350950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.351057] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be updated. [ 971.387329] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.387540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.387607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.387837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.388283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.398334] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 971.653115] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.653359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.653438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.653673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.653887] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.654032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.654109] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.654324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.654431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.654983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.654983] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.654983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.654983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.655183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.655289] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.655566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.655566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.655566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.655905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.655905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.655905] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.841246] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.841526] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.841574] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.841897] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.842113] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.842302] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 3b13b015-f932-4599-9d17-1fcca6b95438 not found, creating... [ 971.842644] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.842845] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.843053] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.843742] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.843742] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.843915] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.844411] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.844641] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.844916] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.846686] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.846686] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 3b13b015-f932-4599-9d17-1fcca6b95438 is going to be created. [ 971.867772] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.868041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.868137] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.868421] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.868643] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.868882] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-3b13b015-f932-4599-9d17-1fcca6b95438" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.037708] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 in Status: SUCCESS [ 972.037937] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 deletion is rescheduled due to dependency. [ 972.038059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.162745] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6779288d-3538-4416-9c3b-5f739846d8f3: rpc.has_security_group_logging(os_id): False [ 972.185504] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.190927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.190927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.190927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.213086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.213086] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.213086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.213086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.213086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.213086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.213086] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.213086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.213086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.213086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.213086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.213760] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.213995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.214186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.214444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.214744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.215020] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 972.301464] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.301464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.301464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.301464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.301464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.316890] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 972.654183] env[66854]: INFO networking_nsxv3.common.synchronization [req-b30d4d3d-ae6a-460a-ad29-a0aad5202ff6 req-c57fc9ec-0c94-4cdf-847f-3b63afff21ff service nova] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_rules [ 972.654397] env[66854]: INFO networking_nsxv3.common.synchronization [req-b30d4d3d-ae6a-460a-ad29-a0aad5202ff6 req-c57fc9ec-0c94-4cdf-847f-3b63afff21ff service nova] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 972.654544] env[66854]: INFO networking_nsxv3.common.synchronization [req-b30d4d3d-ae6a-460a-ad29-a0aad5202ff6 req-c57fc9ec-0c94-4cdf-847f-3b63afff21ff service nova] Enqueued Resource ID: 3b13b015-f932-4599-9d17-1fcca6b95438 with Priority: HIGHEST for action port [ 972.655164] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_rules [ 972.655322] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 972.655477] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b13b015-f932-4599-9d17-1fcca6b95438 with Priority: HIGHEST for action port [ 972.655758] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.655879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.655946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.656567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.656697] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.659800] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.659800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.659800] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b13b015-f932-4599-9d17-1fcca6b95438 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.659800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b13b015-f932-4599-9d17-1fcca6b95438" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.659800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b13b015-f932-4599-9d17-1fcca6b95438" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.659800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b13b015-f932-4599-9d17-1fcca6b95438" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.659800] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b13b015-f932-4599-9d17-1fcca6b95438',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.164567] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.164980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.164980] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b13b015-f932-4599-9d17-1fcca6b95438 with status ACTIVE [ 973.165185] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.165296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.165361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.165630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.165705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.165827] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.165997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.166146] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.166224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.166302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.166491] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.166584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.166736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.166824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.166894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.167008] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b13b015-f932-4599-9d17-1fcca6b95438 is going to be updated. [ 973.203350] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.203820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.203820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.203946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.204127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.204363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b13b015-f932-4599-9d17-1fcca6b95438" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.412082] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 973.413210] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce deletion is rescheduled due to dependency. [ 973.413210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.413379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.413639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.413920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.414069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.414156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.414370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.414466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.414574] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.921620] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.336314] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 974.336623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.424166] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.600185] env[66854]: INFO networking_nsxv3.common.synchronization [None req-e637597e-97b1-4393-855e-2041e26d4d86 tempest-AttachVolumeTestJSON-1641278713 tempest-AttachVolumeTestJSON-1641278713-project-member] Enqueued Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_rules [ 974.602144] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_rules [ 974.602144] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c19902d-3838-4141-b1c1-8a0050b66720 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.602144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.602144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.602144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.602144] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.753945] env[66854]: INFO networking_nsxv3.common.synchronization [req-1b5e6b82-2fed-4ccf-8106-585aa03d7fb3 req-eb96ef1f-2b3c-4eed-be2e-aaa50b6d77ac tempest-ServerActionsV293TestJSON-908997761 tempest-ServerActionsV293TestJSON-908997761-project-member] Enqueued Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_members [ 974.754855] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGHEST for action security_group_members [ 974.755258] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c2a68c-9d14-4fc3-b48e-002677e41a31 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.755543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.755543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.756026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.756026] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.756026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.756196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.756196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.756287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.756420] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.926764] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.929082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.929082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.929082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.929082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.929082] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be updated. [ 974.959279] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.959500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.959500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.959749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.959898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.969825] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 975.023398] env[66854]: INFO networking_nsxv3.common.synchronization [None req-4324d0aa-89a5-4c97-b074-5cc54d2db349 tempest-AttachVolumeTestJSON-1641278713 tempest-AttachVolumeTestJSON-1641278713-project-member] Enqueued Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_rules [ 975.024130] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_rules [ 975.024527] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c19902d-3838-4141-b1c1-8a0050b66720 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.024980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.125047] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.125047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.125047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.125047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.125047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.125047] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c19902d-3838-4141-b1c1-8a0050b66720 already deleted. [ 975.125047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.125582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.125582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.125582] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.204051] env[66854]: INFO networking_nsxv3.common.synchronization [None req-380f7ec9-4d01-48fc-af12-fe6997779f8d None None] Enqueued Resource ID: 3f922256-d597-4486-8f6d-47ad0add70c2 with Priority: HIGHEST for action port [ 975.204686] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f922256-d597-4486-8f6d-47ad0add70c2 with Priority: HIGHEST for action port [ 975.205775] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f922256-d597-4486-8f6d-47ad0add70c2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.206108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f922256-d597-4486-8f6d-47ad0add70c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.206359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f922256-d597-4486-8f6d-47ad0add70c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.207056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f922256-d597-4486-8f6d-47ad0add70c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.207425] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f922256-d597-4486-8f6d-47ad0add70c2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.258134] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.258335] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.258433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.258738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.287236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.287581] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.287759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.287828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.287997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.288139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.288242] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 is going to be updated. [ 975.323984] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.324205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.324266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.324689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.324689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.344047] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 in Status: IN_PROGRESS for 2s [ 975.657488] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.657655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.657728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.658097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.658097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.658267] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c19902d-3838-4141-b1c1-8a0050b66720 already deleted. [ 975.658376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.711509] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f922256-d597-4486-8f6d-47ad0add70c2 [ 975.711804] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.711933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.712022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.712235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.712328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.712405] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f922256-d597-4486-8f6d-47ad0add70c2 already deleted. [ 975.713095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f922256-d597-4486-8f6d-47ad0add70c2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.982442] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 976.982817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.982972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.986137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.986137] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.986137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.986137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.986137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.986137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.986137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.986137] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.360828] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 in Status: SUCCESS [ 977.361589] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 deletion is rescheduled due to dependency. [ 977.361589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.492000] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.492000] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.492000] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.492000] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.492000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.492690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.492690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.492690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.492690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.492690] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.996772] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc128a33-d808-470d-8d77-03637a1be1ce: rpc.has_security_group_logging(os_id): False [ 978.020730] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.020730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.020730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.020730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.020730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.020730] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.020730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.020730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.020730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.021154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.021154] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.021391] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.021391] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.021519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.021628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.021859] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.021966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.022057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.022211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.022298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.022386] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be updated. [ 978.111683] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.111683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.111683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.111683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.111683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.132479] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 978.238337] env[66854]: INFO networking_nsxv3.common.synchronization [None req-d4a583e4-3821-4fa7-bec7-fcfae1217dd6 None None] Enqueued Resource ID: dcb819a4-9ba2-49b4-94df-a7d765519b4d with Priority: HIGHEST for action port [ 978.240327] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcb819a4-9ba2-49b4-94df-a7d765519b4d with Priority: HIGHEST for action port [ 978.240681] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcb819a4-9ba2-49b4-94df-a7d765519b4d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.240973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcb819a4-9ba2-49b4-94df-a7d765519b4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.241271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcb819a4-9ba2-49b4-94df-a7d765519b4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.242990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcb819a4-9ba2-49b4-94df-a7d765519b4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.242990] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcb819a4-9ba2-49b4-94df-a7d765519b4d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.744429] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcb819a4-9ba2-49b4-94df-a7d765519b4d [ 978.744704] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.744839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.745389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.745389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.745389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.745685] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcb819a4-9ba2-49b4-94df-a7d765519b4d already deleted. [ 978.745685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcb819a4-9ba2-49b4-94df-a7d765519b4d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.413680] env[66854]: INFO networking_nsxv3.common.synchronization [req-1efa435a-8900-4b36-93cd-0c6476bedb93 req-fa275808-5246-4729-a87f-ee0235f8b5d2 tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 979.414256] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 979.414567] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.414711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.414760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.414953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.415136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.415236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.415294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.415515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.415608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.415720] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.919808] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.153565] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 980.153983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.423154] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.929218] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.929406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.929491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.929685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.929822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.929967] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 980.962816] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.963027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.963087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.963263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.963412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.974061] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 981.108448] env[66854]: INFO networking_nsxv3.common.synchronization [req-391e9a0f-d38b-4176-bf80-31d422b65664 req-4b917995-8b22-49c4-9c66-76f9369f3d7e tempest-ServersTestJSON-407016126 tempest-ServersTestJSON-407016126-project-member] Enqueued Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_members [ 981.108799] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGHEST for action security_group_members [ 981.110081] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-da272d22-fe1c-4363-b694-0fd0d1bea6e5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.112919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.112919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.112919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.112919] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.112919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.112919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.112919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.112919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.112919] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.508720] env[66854]: INFO networking_nsxv3.common.synchronization [None req-b79ac866-2411-41ef-a1bc-6e92044376a8 None None] Enqueued Resource ID: 4b6828fc-c8a8-4010-90f6-c50f958360d4 with Priority: HIGHEST for action port [ 981.509453] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b6828fc-c8a8-4010-90f6-c50f958360d4 with Priority: HIGHEST for action port [ 981.510223] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b6828fc-c8a8-4010-90f6-c50f958360d4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.510779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b6828fc-c8a8-4010-90f6-c50f958360d4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.510779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b6828fc-c8a8-4010-90f6-c50f958360d4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.510779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b6828fc-c8a8-4010-90f6-c50f958360d4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.510946] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b6828fc-c8a8-4010-90f6-c50f958360d4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.727856] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.728091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.728172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.728359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.728443] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.728649] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.728749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.728811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.728968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.729052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.729143] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 is going to be updated. [ 981.763383] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.763383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.763383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.763383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.763383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.773670] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 in Status: IN_PROGRESS for 2s [ 982.016768] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b6828fc-c8a8-4010-90f6-c50f958360d4 [ 982.016768] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.016978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.017059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.017352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.017489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.017660] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b6828fc-c8a8-4010-90f6-c50f958360d4 already deleted. [ 982.017795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b6828fc-c8a8-4010-90f6-c50f958360d4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.985879] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 982.986302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.786709] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 in Status: SUCCESS [ 983.786709] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 deletion is rescheduled due to dependency. [ 983.786709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.994298] env[66854]: INFO networking_nsxv3.common.synchronization [req-f3688681-20dd-4804-842f-efd873cf5123 req-dd0f069c-cb46-4747-be3a-fe20a639226e tempest-ServerGroupTestJSON-1760304726 tempest-ServerGroupTestJSON-1760304726-project-member] Enqueued Resource ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 with Priority: HIGHEST for action security_group_members [ 983.994891] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 with Priority: HIGHEST for action security_group_members [ 983.995328] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28e22ce0-3477-434c-a48d-67bbaaa395f5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.995468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.995538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.996167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.996167] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.996167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.996369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.996405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.996472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.996578] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28e22ce0-3477-434c-a48d-67bbaaa395f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.226698] env[66854]: INFO networking_nsxv3.common.synchronization [None req-6c5ec70f-3088-4749-9334-e4985b8cf6bc None None] Enqueued Resource ID: a14ca53b-23b4-4f5e-a97b-af67161971e5 with Priority: HIGHEST for action port [ 984.227758] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14ca53b-23b4-4f5e-a97b-af67161971e5 with Priority: HIGHEST for action port [ 984.227758] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-a14ca53b-23b4-4f5e-a97b-af67161971e5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.227933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a14ca53b-23b4-4f5e-a97b-af67161971e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.227933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a14ca53b-23b4-4f5e-a97b-af67161971e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.228253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a14ca53b-23b4-4f5e-a97b-af67161971e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.228337] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a14ca53b-23b4-4f5e-a97b-af67161971e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.499196] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.499449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.499512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.499820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.499968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.500307] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.500429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.500514] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.500736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.500874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.501017] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 already deleted. [ 984.501139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.730502] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a14ca53b-23b4-4f5e-a97b-af67161971e5 [ 984.730831] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.730974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.731063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.731339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.731477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.732156] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a14ca53b-23b4-4f5e-a97b-af67161971e5 already deleted. [ 984.732156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a14ca53b-23b4-4f5e-a97b-af67161971e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.817296] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.817550] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-969" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.817620] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-969" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.829459] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-969" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.831138] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.831138] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.831138] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.831138] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.831138] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.831138] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.831542] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.831674] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.831807] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.831931] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.832053] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.832538] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.862858] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.863118] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 984.863256] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.863441] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-969" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.863822] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-2c589879-8899-4f5e-a0ce-492b9e880a0b taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.864130] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-2c589879-8899-4f5e-a0ce-492b9e880a0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.864269] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-2c589879-8899-4f5e-a0ce-492b9e880a0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.864693] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-2c589879-8899-4f5e-a0ce-492b9e880a0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.864861] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c589879-8899-4f5e-a0ce-492b9e880a0b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.367930] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.369106] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.369106] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.369190] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.369326] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.369487] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 2c589879-8899-4f5e-a0ce-492b9e880a0b not found, creating... [ 985.369757] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.369926] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.370052] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.370300] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.370416] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.370707] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.370854] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.370967] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.371200] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.371332] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.371469] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 2c589879-8899-4f5e-a0ce-492b9e880a0b is going to be created. [ 985.392298] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.392730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.392730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.393337] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.393337] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.393445] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-2c589879-8899-4f5e-a0ce-492b9e880a0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.464747] env[66854]: INFO networking_nsxv3.common.synchronization [req-cf35185a-4a3e-44e3-a4c8-8ba279979572 req-9f4b40bc-a182-4b4e-9b96-019517e42316 tempest-ServersNegativeTestJSON-789183655 tempest-ServersNegativeTestJSON-789183655-project-member] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 985.465474] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 985.465785] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.465978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.465978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.466393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.466459] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.466524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.466636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.466755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.467097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.467097] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.803080] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-643 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.803276] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.803398] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.803692] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.803978] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.804167] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.804269] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.804526] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.804699] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.804914] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.805056] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.805239] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.805359] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.805486] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.805597] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.805728] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.823727] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.823914] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.824076] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.824255] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.824592] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-11cee6f2-cb1a-4cd2-9df4-b2930f1253aa taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.824763] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-11cee6f2-cb1a-4cd2-9df4-b2930f1253aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.824883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-11cee6f2-cb1a-4cd2-9df4-b2930f1253aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.825239] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-11cee6f2-cb1a-4cd2-9df4-b2930f1253aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.825376] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11cee6f2-cb1a-4cd2-9df4-b2930f1253aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.970110] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.070298] env[66854]: INFO networking_nsxv3.common.synchronization [req-f3688681-20dd-4804-842f-efd873cf5123 req-a17a8a2e-3df5-4e20-b23d-9fd077405bf6 service nova] Enqueued Resource ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 with Priority: HIGHEST for action security_group_rules [ 986.070478] env[66854]: INFO networking_nsxv3.common.synchronization [req-f3688681-20dd-4804-842f-efd873cf5123 req-a17a8a2e-3df5-4e20-b23d-9fd077405bf6 service nova] Enqueued Resource ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 with Priority: HIGHEST for action security_group_members [ 986.070616] env[66854]: INFO networking_nsxv3.common.synchronization [req-f3688681-20dd-4804-842f-efd873cf5123 req-a17a8a2e-3df5-4e20-b23d-9fd077405bf6 service nova] Enqueued Resource ID: 2c589879-8899-4f5e-a0ce-492b9e880a0b with Priority: HIGHEST for action port [ 986.071149] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 with Priority: HIGHEST for action security_group_rules [ 986.071149] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 with Priority: HIGHEST for action security_group_members [ 986.071327] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c589879-8899-4f5e-a0ce-492b9e880a0b with Priority: HIGHEST for action port [ 986.073247] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28e22ce0-3477-434c-a48d-67bbaaa395f5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.074139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.074235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.074573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.074613] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28e22ce0-3477-434c-a48d-67bbaaa395f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.075519] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28e22ce0-3477-434c-a48d-67bbaaa395f5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.076321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.076410] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.076675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.076872] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.076984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.077072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.077287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.077386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.077488] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28e22ce0-3477-434c-a48d-67bbaaa395f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.078839] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c589879-8899-4f5e-a0ce-492b9e880a0b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.078950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c589879-8899-4f5e-a0ce-492b9e880a0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.079028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c589879-8899-4f5e-a0ce-492b9e880a0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.079192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c589879-8899-4f5e-a0ce-492b9e880a0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.079274] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c589879-8899-4f5e-a0ce-492b9e880a0b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.327778] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.328125] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.328272] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.328649] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.328852] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.329027] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 11cee6f2-cb1a-4cd2-9df4-b2930f1253aa not found, creating... [ 986.329295] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.329451] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.329567] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.329789] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.329923] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.330216] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.330424] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.330557] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.330765] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.330898] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.331045] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 11cee6f2-cb1a-4cd2-9df4-b2930f1253aa is going to be created. [ 986.353381] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.353636] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.353821] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.354122] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.354362] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.354588] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-11cee6f2-cb1a-4cd2-9df4-b2930f1253aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.471990] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.581035] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28e22ce0-3477-434c-a48d-67bbaaa395f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.582653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28e22ce0-3477-434c-a48d-67bbaaa395f5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.582742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.583130] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c589879-8899-4f5e-a0ce-492b9e880a0b with status ACTIVE [ 986.583241] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.584191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.584277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.584516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.584602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.584786] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.584876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.584941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.585341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.585341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.585445] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.585494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.585528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.585671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.585779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.585826] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c589879-8899-4f5e-a0ce-492b9e880a0b is going to be updated. [ 986.610174] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.610500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.610500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.610602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.610738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.610893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c589879-8899-4f5e-a0ce-492b9e880a0b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.974910] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.975145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.975225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.975531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.975632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.975791] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 is going to be updated. [ 987.005866] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.006214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.006214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.006414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.006477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.017022] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: IN_PROGRESS for 2s [ 987.088297] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28e22ce0-3477-434c-a48d-67bbaaa395f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.101760] env[66854]: INFO networking_nsxv3.common.synchronization [req-cf35185a-4a3e-44e3-a4c8-8ba279979572 req-01785c7d-9c38-4ed2-86d9-d614ec8a6f4b service nova] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_rules [ 987.102029] env[66854]: INFO networking_nsxv3.common.synchronization [req-cf35185a-4a3e-44e3-a4c8-8ba279979572 req-01785c7d-9c38-4ed2-86d9-d614ec8a6f4b service nova] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 987.102199] env[66854]: INFO networking_nsxv3.common.synchronization [req-cf35185a-4a3e-44e3-a4c8-8ba279979572 req-01785c7d-9c38-4ed2-86d9-d614ec8a6f4b service nova] Enqueued Resource ID: 11cee6f2-cb1a-4cd2-9df4-b2930f1253aa with Priority: HIGHEST for action port [ 987.103011] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_rules [ 987.103232] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 987.103318] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11cee6f2-cb1a-4cd2-9df4-b2930f1253aa with Priority: HIGHEST for action port [ 987.104644] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.104644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.104644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.104644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.104644] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.105754] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.105754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.108682] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-11cee6f2-cb1a-4cd2-9df4-b2930f1253aa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.108682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11cee6f2-cb1a-4cd2-9df4-b2930f1253aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.108682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11cee6f2-cb1a-4cd2-9df4-b2930f1253aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.108682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11cee6f2-cb1a-4cd2-9df4-b2930f1253aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.108682] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11cee6f2-cb1a-4cd2-9df4-b2930f1253aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.590979] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.590979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.590979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.590979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.591494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.591494] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 is going to be created. [ 987.608417] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.608638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.608728] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11cee6f2-cb1a-4cd2-9df4-b2930f1253aa with status ACTIVE [ 987.608889] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.608992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.609071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.609286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.609374] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.609554] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.609650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.609712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.609864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.609941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.610139] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.610237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.610299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.610637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.610637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.610637] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11cee6f2-cb1a-4cd2-9df4-b2930f1253aa is going to be updated. [ 987.616671] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.616671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.616925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.616925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.617050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.626988] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 in Status: UNINITIALIZED for 2s [ 987.636417] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.636546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.636618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.636815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.636973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.637171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11cee6f2-cb1a-4cd2-9df4-b2930f1253aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.039760] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: SUCCESS [ 989.039760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.039760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.039760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.039760] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.039760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.039760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.039760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.039760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.039760] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.536047] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.639506] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 in Status: SUCCESS [ 989.639506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.639506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.639506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.639506] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.639719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.639719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.639838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.640121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.640121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.640121] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28e22ce0-3477-434c-a48d-67bbaaa395f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.038496] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.142994] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28e22ce0-3477-434c-a48d-67bbaaa395f5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.143386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.143386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.143541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.143716] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.143812] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.143878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.144036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.144120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.144206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.144362] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28e22ce0-3477-434c-a48d-67bbaaa395f5 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.144526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.144586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.144735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.144892] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.144981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.145054] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.145191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.145266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.145350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.145440] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28e22ce0-3477-434c-a48d-67bbaaa395f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.541195] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.541508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.541508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.541824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.541922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.542047] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 is going to be updated. [ 990.581311] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.581311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.581311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.581502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.581556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.599122] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: IN_PROGRESS for 2s [ 990.647684] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28e22ce0-3477-434c-a48d-67bbaaa395f5: rpc.has_security_group_logging(os_id): False [ 990.668294] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.668530] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.668598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.668827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.668953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.669154] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.669276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.669340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.669500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.669573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.669804] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.669912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.669912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.670115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.670170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.670359] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.670471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.670529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.670650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.670735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.670920] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 is going to be created. [ 990.769853] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.769986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.769986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.770219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.770403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.784024] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 in Status: IN_PROGRESS for 2s [ 992.104412] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 992.104805] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 992.614059] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: SUCCESS [ 992.614059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.614059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.614059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.614404] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.614404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.614404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.614567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.614653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.614804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.614870] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.652610] env[66854]: INFO networking_nsxv3.common.synchronization [req-08c5705c-3e80-481d-8938-ce8426e90ae4 req-df0a178a-377c-461f-a08a-227bf396c067 tempest-ServersWithSpecificFlavorTestJSON-1363282919 tempest-ServersWithSpecificFlavorTestJSON-1363282919-project-member] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 992.653370] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGHEST for action security_group_members [ 992.653710] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.653840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.653908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.654150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.654353] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.654444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.654483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.654639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.654752] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.654879] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.730207] env[66854]: INFO networking_nsxv3.common.synchronization [req-01240983-3e1e-4a77-8bb4-5c3f3bd186c5 req-a06b5a05-1182-497f-8e6d-3091165a82b4 tempest-ImagesOneServerNegativeTestJSON-1585579513 tempest-ImagesOneServerNegativeTestJSON-1585579513-project-member] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 992.730207] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGHEST for action security_group_members [ 992.730207] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.730466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.730649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.730950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.731227] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.731449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.731599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.731882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.732155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.732390] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.799629] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 in Status: SUCCESS [ 992.799629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.056926] env[66854]: INFO networking_nsxv3.common.synchronization [req-41f2f610-f54b-4f43-a24b-e836d7e0c7d8 req-7ab42145-6a22-47b9-bc9a-bb8f7ed76e0b tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 993.057668] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 993.057947] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.058306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.058488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.058792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.058990] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.059139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.059227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.059415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.059530] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.059653] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.119557] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.119873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.119873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.120022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.120201] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.120298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.120361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.120509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.120593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.120683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.120834] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.120926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.120986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.121164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.121286] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.121377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.121438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.121572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.121646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.121728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.121819] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.159128] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.159336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.159378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.159660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.187809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.188296] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.188442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.189100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.189100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.189100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.189226] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e is going to be updated. [ 993.226537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.226798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.226878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.227165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.227321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.235287] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.235612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.235749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.235962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.236085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.236299] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.236411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.236486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.236671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.236805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.236920] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be updated. [ 993.239222] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: IN_PROGRESS for 2s [ 993.267780] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.268139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.268261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.268581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.268947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.280533] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: IN_PROGRESS for 2s [ 993.561785] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.561974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.562128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.562297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.562389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.562937] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.562937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.562937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.562937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.563170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.563170] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 already deleted. [ 993.563170] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.624315] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a12683d9-3f0c-4d0e-adac-f42cb41ab395: rpc.has_security_group_logging(os_id): False [ 993.648637] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.649998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.650130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.650385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.650485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.650744] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.650842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.650908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.651072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.651154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.651344] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.651441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.651502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.651640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.651714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.651891] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.651983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.655350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.655539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.655626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.655724] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 is going to be updated. [ 993.722264] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.722481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.722481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.722706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.722917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.738321] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: IN_PROGRESS for 2s [ 994.187219] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.187613] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.187613] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.188063] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.188504] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.189479] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.189621] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.189948] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.190153] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.190383] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.190503] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.190614] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.190722] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.190845] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.190986] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.191402] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.210299] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.210486] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.210620] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.210805] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.211137] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-bfb8903d-c1e6-4164-82b3-1c6f7e679ff2 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.211309] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-bfb8903d-c1e6-4164-82b3-1c6f7e679ff2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.211423] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-bfb8903d-c1e6-4164-82b3-1c6f7e679ff2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.211823] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-bfb8903d-c1e6-4164-82b3-1c6f7e679ff2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.211998] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfb8903d-c1e6-4164-82b3-1c6f7e679ff2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.218811] env[66854]: INFO networking_nsxv3.common.synchronization [req-ef0a0b6d-11d1-4a31-aa4f-88a61af13693 req-c1a22604-a621-400d-be7a-314edc72a441 tempest-ImagesTestJSON-1862869845 tempest-ImagesTestJSON-1862869845-project-member] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 994.219403] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 994.219728] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.219851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.219920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.220167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.220387] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.220497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.220563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.220780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.220848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.220904] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.714275] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.714512] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.714640] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.715027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.715130] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.715294] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port bfb8903d-c1e6-4164-82b3-1c6f7e679ff2 not found, creating... [ 994.715556] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.715712] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.715829] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.716066] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.716204] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.716857] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.718092] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.718217] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.718469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.718613] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.718775] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: bfb8903d-c1e6-4164-82b3-1c6f7e679ff2 is going to be created. [ 994.724628] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.724765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.724848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.725037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.725123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.725369] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.725422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.725473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.725622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.725697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.725781] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 994.744424] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.745369] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.745369] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.745369] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.745717] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.745717] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-bfb8903d-c1e6-4164-82b3-1c6f7e679ff2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.753235] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.753411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.753505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.753792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.753920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.763341] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 995.250165] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e in Status: SUCCESS [ 995.250492] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e deletion is rescheduled due to dependency. [ 995.250530] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.292035] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc128a33-d808-470d-8d77-03637a1be1ce in Status: SUCCESS [ 995.292191] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc128a33-d808-470d-8d77-03637a1be1ce deletion is rescheduled due to dependency. [ 995.292191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.501144] env[66854]: INFO networking_nsxv3.common.synchronization [req-41f2f610-f54b-4f43-a24b-e836d7e0c7d8 req-d8303341-a7bf-4369-9840-decab51547c7 service nova] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_rules [ 995.501333] env[66854]: INFO networking_nsxv3.common.synchronization [req-41f2f610-f54b-4f43-a24b-e836d7e0c7d8 req-d8303341-a7bf-4369-9840-decab51547c7 service nova] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 995.501473] env[66854]: INFO networking_nsxv3.common.synchronization [req-41f2f610-f54b-4f43-a24b-e836d7e0c7d8 req-d8303341-a7bf-4369-9840-decab51547c7 service nova] Enqueued Resource ID: bfb8903d-c1e6-4164-82b3-1c6f7e679ff2 with Priority: HIGHEST for action port [ 995.501977] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_rules [ 995.502150] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 995.502238] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfb8903d-c1e6-4164-82b3-1c6f7e679ff2 with Priority: HIGHEST for action port [ 995.502499] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.502626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.503867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.504240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.504342] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.506419] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.507242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.507242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.507242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.507693] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.508088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.508232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.508725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.508824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.509037] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.510429] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfb8903d-c1e6-4164-82b3-1c6f7e679ff2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.510559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfb8903d-c1e6-4164-82b3-1c6f7e679ff2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.510615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfb8903d-c1e6-4164-82b3-1c6f7e679ff2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.511515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfb8903d-c1e6-4164-82b3-1c6f7e679ff2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.511515] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfb8903d-c1e6-4164-82b3-1c6f7e679ff2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.753673] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: SUCCESS [ 995.753818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.007776] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.008124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.013817] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.014517] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfb8903d-c1e6-4164-82b3-1c6f7e679ff2 with status ACTIVE [ 996.014742] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.014971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.014971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.015186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.015274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.015464] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.015560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.015617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.016407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.016407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.016407] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.016407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.016407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.016407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.016661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.016661] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfb8903d-c1e6-4164-82b3-1c6f7e679ff2 is going to be updated. [ 996.037551] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.037785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.037785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.038019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.038136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.038875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfb8903d-c1e6-4164-82b3-1c6f7e679ff2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.519137] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.773975] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 996.773975] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 deletion is rescheduled due to dependency. [ 996.773975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.024500] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.024500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.024500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.024500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.024500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.024500] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be created. [ 997.048065] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.048251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.048323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.048555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.049212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.060651] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: UNINITIALIZED for 2s [ 998.282329] env[66854]: INFO networking_nsxv3.common.synchronization [req-c477cf1a-a6dd-4b65-bf4f-e5fd72bbdfc8 req-9e2a8d15-eb24-4604-8f9e-02b9728652f0 tempest-InstanceActionsV221TestJSON-2053327087 tempest-InstanceActionsV221TestJSON-2053327087-project-member] Enqueued Resource ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a with Priority: HIGHEST for action security_group_members [ 998.282932] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a with Priority: HIGHEST for action security_group_members [ 998.283311] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.283499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.283499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.283735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.283903] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.284018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.284080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.284240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.284426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.284426] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd8df7a7-7bdc-4ef6-8502-08f458c1982a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.689906] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-982 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.690134] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-982" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.690285] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-982" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.690653] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-982" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.690924] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.691132] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.691316] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.691564] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.691760] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.692049] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.692236] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.692403] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.692564] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.692776] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.692850] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.693257] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.718657] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.719154] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 998.719154] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.719257] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-982" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.719818] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-32ccefd1-5c02-4921-b8ac-2984abb88b05 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.719818] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-32ccefd1-5c02-4921-b8ac-2984abb88b05" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.719981] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-32ccefd1-5c02-4921-b8ac-2984abb88b05" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.720936] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-32ccefd1-5c02-4921-b8ac-2984abb88b05" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.720936] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32ccefd1-5c02-4921-b8ac-2984abb88b05',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.788175] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.788175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.788175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.788479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.788511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.788752] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.788875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.788989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.789131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.789236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.789317] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a already deleted. [ 998.789415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.070443] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 999.070667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.070837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.071065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.071261] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.071379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.071469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.071593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.071673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.071756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.071854] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.223052] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.223287] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.223403] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.223830] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.224033] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.224195] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 32ccefd1-5c02-4921-b8ac-2984abb88b05 not found, creating... [ 999.224504] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.224710] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.224839] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.225182] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.225371] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.225701] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.225900] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.226037] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.226259] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.226592] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.226592] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 32ccefd1-5c02-4921-b8ac-2984abb88b05 is going to be created. [ 999.254636] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.254636] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.254636] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.254636] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.254636] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.254988] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-32ccefd1-5c02-4921-b8ac-2984abb88b05" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.576172] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.576172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.576172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.576172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.576172] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.576172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.576172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.576172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.576172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.576172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.576901] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.576901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.576901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.576901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.576901] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.576901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.576901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.577154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.577154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.577246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.577383] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.643398] env[66854]: INFO networking_nsxv3.common.synchronization [req-08187c17-3c34-47e1-8d12-476bd7445ecb req-d876bce3-ea4b-42fb-8d8b-3846c28369a7 tempest-ServerGroupTestJSON-1760304726 tempest-ServerGroupTestJSON-1760304726-project-member] Enqueued Resource ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 with Priority: HIGHEST for action security_group_members [ 999.644119] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 with Priority: HIGHEST for action security_group_members [ 999.644527] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-28e22ce0-3477-434c-a48d-67bbaaa395f5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.644611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.644711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.644860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.645027] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.645126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.645412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.645412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.645549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.645549] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28e22ce0-3477-434c-a48d-67bbaaa395f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.953089] env[66854]: INFO networking_nsxv3.common.synchronization [req-c477cf1a-a6dd-4b65-bf4f-e5fd72bbdfc8 req-e98862d3-0236-4847-9615-a038aa388d04 service nova] Enqueued Resource ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a with Priority: HIGHEST for action security_group_rules [ 999.953369] env[66854]: INFO networking_nsxv3.common.synchronization [req-c477cf1a-a6dd-4b65-bf4f-e5fd72bbdfc8 req-e98862d3-0236-4847-9615-a038aa388d04 service nova] Enqueued Resource ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a with Priority: HIGHEST for action security_group_members [ 999.953522] env[66854]: INFO networking_nsxv3.common.synchronization [req-c477cf1a-a6dd-4b65-bf4f-e5fd72bbdfc8 req-e98862d3-0236-4847-9615-a038aa388d04 service nova] Enqueued Resource ID: 32ccefd1-5c02-4921-b8ac-2984abb88b05 with Priority: HIGHEST for action port [ 999.954062] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a with Priority: HIGHEST for action security_group_rules [ 999.954211] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a with Priority: HIGHEST for action security_group_members [ 999.954307] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ccefd1-5c02-4921-b8ac-2984abb88b05 with Priority: HIGHEST for action port [ 999.954574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd8df7a7-7bdc-4ef6-8502-08f458c1982a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.954692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.954758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.955019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.955896] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd8df7a7-7bdc-4ef6-8502-08f458c1982a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.956080] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.956882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.956882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.956882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.956882] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.956882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.956882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.959141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.959238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.959339] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd8df7a7-7bdc-4ef6-8502-08f458c1982a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.960124] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-32ccefd1-5c02-4921-b8ac-2984abb88b05 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.960454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32ccefd1-5c02-4921-b8ac-2984abb88b05" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.960454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32ccefd1-5c02-4921-b8ac-2984abb88b05" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.960454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32ccefd1-5c02-4921-b8ac-2984abb88b05" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.960586] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32ccefd1-5c02-4921-b8ac-2984abb88b05',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.079607] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a25ac3d-b904-4054-a34f-271c7b608728: rpc.has_security_group_logging(os_id): False [ 1000.105979] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.105979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.105979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.105979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.105979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.105979] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.105979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.109431] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.109431] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.109431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.109431] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be created. [ 1000.147606] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.147695] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.147835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.148323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.148323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.148323] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.148586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.148586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.148586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.148707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.148707] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 is going to be updated. [ 1000.161259] env[66854]: INFO networking_nsxv3.common.synchronization [req-04d55b83-73f5-46c9-922b-eed2347554ef req-bf5df2a0-3c0e-4159-82e6-21c7b960412c tempest-ServersNegativeTestJSON-789183655 tempest-ServersNegativeTestJSON-789183655-project-member] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 1000.161259] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 1000.161259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.161259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.161259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.161545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.161790] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.161790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.161955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.162118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.162232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.162352] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.167031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.167824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.167943] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.168190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.168427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.182344] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.182507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.182603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.182831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.183010] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.186995] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1000.195204] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 in Status: IN_PROGRESS for 2s [ 1000.462035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.462196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.465625] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd8df7a7-7bdc-4ef6-8502-08f458c1982a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.468043] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32ccefd1-5c02-4921-b8ac-2984abb88b05 with status ACTIVE [ 1000.468243] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.468371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.468434] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.468653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.468740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.468914] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.469030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.469096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.469251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.469326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.469550] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.469619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.469652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.469792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.469864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.469949] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32ccefd1-5c02-4921-b8ac-2984abb88b05 is going to be updated. [ 1000.496770] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.496770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.496770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.496770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.496770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.497021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32ccefd1-5c02-4921-b8ac-2984abb88b05" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.670664] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.970719] env[66854]: INFO networking_nsxv3.common.synchronization [req-3081405a-7c51-4098-9339-80030416106f req-6bc838af-bd3d-4891-89b3-a740a3a6e9ff tempest-AttachVolumeTestJSON-1641278713 tempest-AttachVolumeTestJSON-1641278713-project-member] Enqueued Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_members [ 1000.973079] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_members [ 1000.973545] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd8df7a7-7bdc-4ef6-8502-08f458c1982a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.974653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c19902d-3838-4141-b1c1-8a0050b66720 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.974653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.974831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.975497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.975691] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.976129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.976203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.976414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.976493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.976631] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.174639] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.478833] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.479639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.479639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.479639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.479639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.479639] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a is going to be created. [ 1001.483845] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.483845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.483845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.483845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.483845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.483845] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.483845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.483845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.483845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.483845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.484459] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c19902d-3838-4141-b1c1-8a0050b66720 already deleted. [ 1001.484459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.512879] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.512879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.512879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.512879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.512879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.525079] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a in Status: UNINITIALIZED for 2s [ 1001.677245] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.677547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.677547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.677825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.677945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.678083] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 is going to be updated. [ 1001.711019] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.711230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.711230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.711664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.711664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.735110] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: IN_PROGRESS for 2s [ 1001.874827] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-699 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.875343] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-699" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.875597] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-699" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.876307] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-699" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.876655] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.877119] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.877285] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.877590] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.877785] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.878064] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.878214] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.878352] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.878497] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.878649] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.878774] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.878968] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.897700] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.897958] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1001.898137] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.898421] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-699" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.898668] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-7fdf3328-42ce-4ed3-8dbb-9a2205400f8d taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.898848] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-7fdf3328-42ce-4ed3-8dbb-9a2205400f8d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.898968] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-7fdf3328-42ce-4ed3-8dbb-9a2205400f8d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.899309] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-7fdf3328-42ce-4ed3-8dbb-9a2205400f8d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.899448] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fdf3328-42ce-4ed3-8dbb-9a2205400f8d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.203384] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1002.203606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.204980] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 in Status: SUCCESS [ 1002.205270] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 deletion is rescheduled due to dependency. [ 1002.205438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.402013] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.403983] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.404185] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.404511] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.404704] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.404836] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 7fdf3328-42ce-4ed3-8dbb-9a2205400f8d not found, creating... [ 1002.405177] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.405336] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.405522] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.405745] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.405895] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.406229] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.406394] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.406515] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.406730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.406870] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.407021] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 7fdf3328-42ce-4ed3-8dbb-9a2205400f8d is going to be created. [ 1002.443164] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.443389] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.443490] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.443776] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.444021] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.444285] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-7fdf3328-42ce-4ed3-8dbb-9a2205400f8d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.154321] env[66854]: INFO networking_nsxv3.common.synchronization [req-3081405a-7c51-4098-9339-80030416106f req-d48d32b1-72df-4edf-9e4f-b6672ade6459 service nova] Enqueued Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_rules [ 1003.154547] env[66854]: INFO networking_nsxv3.common.synchronization [req-3081405a-7c51-4098-9339-80030416106f req-d48d32b1-72df-4edf-9e4f-b6672ade6459 service nova] Enqueued Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_members [ 1003.154686] env[66854]: INFO networking_nsxv3.common.synchronization [req-3081405a-7c51-4098-9339-80030416106f req-d48d32b1-72df-4edf-9e4f-b6672ade6459 service nova] Enqueued Resource ID: 7fdf3328-42ce-4ed3-8dbb-9a2205400f8d with Priority: HIGHEST for action port [ 1003.155518] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_rules [ 1003.155673] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_members [ 1003.155787] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdf3328-42ce-4ed3-8dbb-9a2205400f8d with Priority: HIGHEST for action port [ 1003.165120] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c19902d-3838-4141-b1c1-8a0050b66720 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.165350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.165437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.165712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.165827] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.167874] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c19902d-3838-4141-b1c1-8a0050b66720 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.167874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.167874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.167874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.167874] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.167874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.167874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.168187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.168187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.170120] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.171031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fdf3328-42ce-4ed3-8dbb-9a2205400f8d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.172020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fdf3328-42ce-4ed3-8dbb-9a2205400f8d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.172020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fdf3328-42ce-4ed3-8dbb-9a2205400f8d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.172020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fdf3328-42ce-4ed3-8dbb-9a2205400f8d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.172020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fdf3328-42ce-4ed3-8dbb-9a2205400f8d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.539053] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a in Status: SUCCESS [ 1003.539053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.539053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.539053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.539053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.539053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.539053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.539053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.539053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.539053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.539053] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd8df7a7-7bdc-4ef6-8502-08f458c1982a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.673934] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c19902d-3838-4141-b1c1-8a0050b66720 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.673934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.674082] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.674912] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7fdf3328-42ce-4ed3-8dbb-9a2205400f8d with status ACTIVE [ 1003.675298] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.675298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.675298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.677718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.677718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.677718] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.677718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.677718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.677718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.677718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.677718] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.677718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.677718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.677718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.677718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.677718] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7fdf3328-42ce-4ed3-8dbb-9a2205400f8d is going to be updated. [ 1003.714994] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.715143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.715143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.715452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.715542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.715738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fdf3328-42ce-4ed3-8dbb-9a2205400f8d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.749184] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: SUCCESS [ 1003.749444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.940178] env[66854]: INFO networking_nsxv3.common.synchronization [req-4b9fe847-45dd-4fec-8306-31436d943166 req-eca55c1d-817b-47a2-8422-e0ab4dee0c94 tempest-ServerRescueTestJSON-1131573559 tempest-ServerRescueTestJSON-1131573559-project-member] Enqueued Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1003.940962] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1003.941322] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.941510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.941510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.941858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.942433] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.942764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.943272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.943636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.943800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.943958] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.040616] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.040777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.040867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.041090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.041256] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.041352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.041406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.041551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.041625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.041726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.042169] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.042169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.042169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.042169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.042903] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.042903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.042903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.042903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.042903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.042903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.042903] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd8df7a7-7bdc-4ef6-8502-08f458c1982a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.178937] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.437932] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.438161] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-529" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.438347] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-529" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.438939] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-529" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.439328] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.439510] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.439659] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.439919] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.440101] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.440343] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.440468] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.440601] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.440724] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.440847] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.440973] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.441141] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.447736] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.447881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.447991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.448212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.448298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.448500] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.448591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.448797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.448973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.449067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.449216] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee66d96e-b19b-40e4-b459-52eebc42250e already deleted. [ 1004.449281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.461682] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.461865] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.462014] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.462207] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-529" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.463165] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-34fed89c-623d-4f2b-abd5-c7b3b8e425ea taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.463165] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-34fed89c-623d-4f2b-abd5-c7b3b8e425ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.463165] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-34fed89c-623d-4f2b-abd5-c7b3b8e425ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.463165] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-34fed89c-623d-4f2b-abd5-c7b3b8e425ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.463561] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34fed89c-623d-4f2b-abd5-c7b3b8e425ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.547588] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd8df7a7-7bdc-4ef6-8502-08f458c1982a: rpc.has_security_group_logging(os_id): False [ 1004.569812] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.569982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.570134] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.570369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.570479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.570718] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.571251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.571251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.571251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.571251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.571508] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.571508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.571508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.571693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.571693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.571871] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.572057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.572057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.572181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.572254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.572358] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a is going to be created. [ 1004.641255] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.641465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.641524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.641769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.642317] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.655172] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a in Status: IN_PROGRESS for 2s [ 1004.681689] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.681949] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.681949] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.682246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.682361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.682506] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c19902d-3838-4141-b1c1-8a0050b66720 is going to be created. [ 1004.714309] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.714500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.714500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.714669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.714833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.730325] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c19902d-3838-4141-b1c1-8a0050b66720 in Status: UNINITIALIZED for 2s [ 1004.968685] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.968938] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.969075] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.969344] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.969528] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.969653] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 34fed89c-623d-4f2b-abd5-c7b3b8e425ea not found, creating... [ 1004.969931] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.970104] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.970220] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.970441] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.970576] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.970860] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.971030] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.971152] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.971358] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.971490] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.971628] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 34fed89c-623d-4f2b-abd5-c7b3b8e425ea is going to be created. [ 1004.994507] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.994827] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.995057] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.995471] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.995874] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.996229] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-34fed89c-623d-4f2b-abd5-c7b3b8e425ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.716632] env[66854]: INFO networking_nsxv3.common.synchronization [req-4b9fe847-45dd-4fec-8306-31436d943166 req-626d3a4c-badb-4131-965e-a1a99d4af478 service nova] Enqueued Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_rules [ 1005.716903] env[66854]: INFO networking_nsxv3.common.synchronization [req-4b9fe847-45dd-4fec-8306-31436d943166 req-626d3a4c-badb-4131-965e-a1a99d4af478 service nova] Enqueued Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1005.717281] env[66854]: INFO networking_nsxv3.common.synchronization [req-4b9fe847-45dd-4fec-8306-31436d943166 req-626d3a4c-badb-4131-965e-a1a99d4af478 service nova] Enqueued Resource ID: 34fed89c-623d-4f2b-abd5-c7b3b8e425ea with Priority: HIGHEST for action port [ 1005.717281] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_rules [ 1005.717371] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1005.717410] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fed89c-623d-4f2b-abd5-c7b3b8e425ea with Priority: HIGHEST for action port [ 1005.718080] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.718255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.718425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.718832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.718977] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.720141] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.720323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.720458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.720633] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.720819] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.723401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.723520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.723773] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.723773] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.723773] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.724782] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-34fed89c-623d-4f2b-abd5-c7b3b8e425ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.727690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34fed89c-623d-4f2b-abd5-c7b3b8e425ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.727690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34fed89c-623d-4f2b-abd5-c7b3b8e425ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.727690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34fed89c-623d-4f2b-abd5-c7b3b8e425ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.727690] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34fed89c-623d-4f2b-abd5-c7b3b8e425ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.228573] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.230035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.230035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.230495] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34fed89c-623d-4f2b-abd5-c7b3b8e425ea with status ACTIVE [ 1006.230638] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.231720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.231720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.231720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.231720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.231720] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.232062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.232062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.232161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.232313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.232553] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.232633] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.232786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.232947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.232947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.233174] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34fed89c-623d-4f2b-abd5-c7b3b8e425ea is going to be updated. [ 1006.257220] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.257452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.257527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.257690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.257850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.258130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34fed89c-623d-4f2b-abd5-c7b3b8e425ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.473297] env[66854]: INFO networking_nsxv3.common.synchronization [req-30f13efc-4e89-41e4-8f84-840a902d226a req-4e28e9c7-e904-4b62-8bb6-e47f9a29669d tempest-ImagesTestJSON-1862869845 tempest-ImagesTestJSON-1862869845-project-member] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1006.473917] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1006.474304] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.474443] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.474531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.474776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.475016] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.475124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.475190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.475397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.475832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.475832] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.669239] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a in Status: SUCCESS [ 1006.669515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.731158] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.741442] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c19902d-3838-4141-b1c1-8a0050b66720 in Status: SUCCESS [ 1006.741682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.741843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.742062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.742272] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.742408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.742469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.742631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.742709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.742793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.742885] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.834185] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.834405] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.834541] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.834825] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.835366] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.835540] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.835665] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.835935] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.836103] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.836315] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.836429] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.836580] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.836690] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.836803] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.836909] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.837056] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.857710] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.857880] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.858069] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.858255] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.860276] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-2d86664b-ce6c-4de9-80eb-c9bca06ba6bd taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.860276] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-2d86664b-ce6c-4de9-80eb-c9bca06ba6bd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.860276] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-2d86664b-ce6c-4de9-80eb-c9bca06ba6bd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.860276] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-2d86664b-ce6c-4de9-80eb-c9bca06ba6bd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.860276] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d86664b-ce6c-4de9-80eb-c9bca06ba6bd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.978535] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.978535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.978535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.978535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.978982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.979302] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.979590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.979758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.981372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.981372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.981372] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1007.019796] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.019796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.019796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.019796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.019796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.030635] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1007.234475] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.234751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.234751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.234904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.235015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.235119] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee66d96e-b19b-40e4-b459-52eebc42250e is going to be created. [ 1007.245627] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.259668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.259890] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.259974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.260136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.260301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.270369] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: UNINITIALIZED for 2s [ 1007.362074] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.362354] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.362524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.362882] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.363061] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.363281] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 2d86664b-ce6c-4de9-80eb-c9bca06ba6bd not found, creating... [ 1007.363550] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.363861] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.363989] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.364210] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.364304] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.364698] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.364882] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.365019] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.365277] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.365420] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.365619] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 2d86664b-ce6c-4de9-80eb-c9bca06ba6bd is going to be created. [ 1007.390027] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.390346] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.390477] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.390773] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.390992] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.391319] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-2d86664b-ce6c-4de9-80eb-c9bca06ba6bd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.749537] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c19902d-3838-4141-b1c1-8a0050b66720: rpc.has_security_group_logging(os_id): False [ 1007.772494] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.772763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.772763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.774023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.774023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.774023] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.774023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.774023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.774023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.774023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.774560] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c19902d-3838-4141-b1c1-8a0050b66720 is going to be created. [ 1007.850643] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.850837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.850919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.851186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.851494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.865077] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c19902d-3838-4141-b1c1-8a0050b66720 in Status: IN_PROGRESS for 2s [ 1008.178948] env[66854]: INFO networking_nsxv3.common.synchronization [req-30f13efc-4e89-41e4-8f84-840a902d226a req-26698cf7-4b32-42c2-974b-490529957d59 service nova] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_rules [ 1008.179288] env[66854]: INFO networking_nsxv3.common.synchronization [req-30f13efc-4e89-41e4-8f84-840a902d226a req-26698cf7-4b32-42c2-974b-490529957d59 service nova] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1008.179386] env[66854]: INFO networking_nsxv3.common.synchronization [req-30f13efc-4e89-41e4-8f84-840a902d226a req-26698cf7-4b32-42c2-974b-490529957d59 service nova] Enqueued Resource ID: 2d86664b-ce6c-4de9-80eb-c9bca06ba6bd with Priority: HIGHEST for action port [ 1008.180245] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_rules [ 1008.181033] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1008.181033] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d86664b-ce6c-4de9-80eb-c9bca06ba6bd with Priority: HIGHEST for action port [ 1008.181033] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.181228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.181228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.181355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.181441] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.186021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.186021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.186021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d86664b-ce6c-4de9-80eb-c9bca06ba6bd taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.186021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d86664b-ce6c-4de9-80eb-c9bca06ba6bd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.186021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d86664b-ce6c-4de9-80eb-c9bca06ba6bd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.186021] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d86664b-ce6c-4de9-80eb-c9bca06ba6bd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.186021] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d86664b-ce6c-4de9-80eb-c9bca06ba6bd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.576333] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb429e7a-e13f-4b78-9829-ca10ae6b8803 req-b96972bf-19e5-48cb-8d0b-03ab06f603ee tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1008.577196] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1008.580191] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.580414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.580520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.580868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.581158] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.581313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.581415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.581658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.581790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.581940] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.686400] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d86664b-ce6c-4de9-80eb-c9bca06ba6bd with status ACTIVE [ 1008.686524] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.686689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.686760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.686925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.687025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.687211] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.687310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.687373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.687517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.687591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.687771] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.687859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.687982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.688065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.688174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.688268] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d86664b-ce6c-4de9-80eb-c9bca06ba6bd is going to be updated. [ 1008.689443] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.689551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.715284] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.715284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.715284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.715284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.715284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.715284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d86664b-ce6c-4de9-80eb-c9bca06ba6bd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.013902] env[66854]: INFO networking_nsxv3.common.synchronization [req-b3cb18be-b86b-4746-ac3c-6941c4f8a072 req-9c7d09ee-a403-49f1-9c25-89077e697fb2 tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1009.014570] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1009.014932] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.016941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.017059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.017282] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.018342] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.018342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.018342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.018342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.018342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.018634] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.046809] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1009.047164] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 deletion is rescheduled due to dependency. [ 1009.047353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.047622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.047929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.048335] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.048531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.048610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.048840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.048979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.049516] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.084547] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.084710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.084783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.084996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.085111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.085310] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.085402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.085462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.086029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.086029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.086029] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1009.124873] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.124974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.125101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.127552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.127745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.141325] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1009.282148] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: UNINITIALIZED for 4s [ 1009.431575] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.431803] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.431967] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.432365] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.432668] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.432910] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.433082] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.433322] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.433509] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.433728] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.433839] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.433946] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.434075] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.434213] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.434323] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.434485] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.455150] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.455332] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.455465] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.455626] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.455950] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-3c4df4c7-bbd6-4d7e-8f86-963edae8265f taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.456149] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-3c4df4c7-bbd6-4d7e-8f86-963edae8265f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.456381] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-3c4df4c7-bbd6-4d7e-8f86-963edae8265f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.456688] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-3c4df4c7-bbd6-4d7e-8f86-963edae8265f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.456857] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c4df4c7-bbd6-4d7e-8f86-963edae8265f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.525538] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.525716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.525791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.525988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.526111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.526398] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.526510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.526606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.526822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.526924] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.527034] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1009.552228] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.558573] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.558573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.559074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.559074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.559206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.570180] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1009.882742] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c19902d-3838-4141-b1c1-8a0050b66720 in Status: SUCCESS [ 1009.882742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.962027] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.962027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.962027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.962027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.962027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.962027] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 3c4df4c7-bbd6-4d7e-8f86-963edae8265f not found, creating... [ 1009.962027] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.962027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.962027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.962027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.962027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.962600] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.962891] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.963217] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.963623] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.963883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.964162] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 3c4df4c7-bbd6-4d7e-8f86-963edae8265f is going to be created. [ 1009.991043] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.991043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.991043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.991043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.991043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.991043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-3c4df4c7-bbd6-4d7e-8f86-963edae8265f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.054952] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.561023] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.561023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.561023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.561023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.561023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.561023] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1010.608223] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.608464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.608572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.608847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.609061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.620354] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1010.809884] env[66854]: INFO networking_nsxv3.common.synchronization [req-b3cb18be-b86b-4746-ac3c-6941c4f8a072 req-7cd3214e-ad7f-4cc2-90fd-285fc29a4eff service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 1010.810075] env[66854]: INFO networking_nsxv3.common.synchronization [req-b3cb18be-b86b-4746-ac3c-6941c4f8a072 req-7cd3214e-ad7f-4cc2-90fd-285fc29a4eff service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1010.810217] env[66854]: INFO networking_nsxv3.common.synchronization [req-b3cb18be-b86b-4746-ac3c-6941c4f8a072 req-7cd3214e-ad7f-4cc2-90fd-285fc29a4eff service nova] Enqueued Resource ID: 3c4df4c7-bbd6-4d7e-8f86-963edae8265f with Priority: HIGHEST for action port [ 1010.810763] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 1010.813516] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1010.813644] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4df4c7-bbd6-4d7e-8f86-963edae8265f with Priority: HIGHEST for action port [ 1010.814216] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.814342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.814416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.814933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.814933] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.816667] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.816789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.817656] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c4df4c7-bbd6-4d7e-8f86-963edae8265f taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.817656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c4df4c7-bbd6-4d7e-8f86-963edae8265f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.817656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c4df4c7-bbd6-4d7e-8f86-963edae8265f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.817871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c4df4c7-bbd6-4d7e-8f86-963edae8265f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.817908] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c4df4c7-bbd6-4d7e-8f86-963edae8265f',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.151336] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1011.151624] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 deletion is rescheduled due to dependency. [ 1011.151694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.293666] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: SUCCESS [ 1011.293949] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.294157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.294437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.294702] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.294826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.294914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.295135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.295221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.296146] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.296146] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.319543] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.319690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.320255] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c4df4c7-bbd6-4d7e-8f86-963edae8265f with status ACTIVE [ 1011.320536] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.320680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.320743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.321024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.321117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.321801] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.321801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.321801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.321801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.321801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.322068] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.322068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.322068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.322172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.322211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.322288] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c4df4c7-bbd6-4d7e-8f86-963edae8265f is going to be updated. [ 1011.365365] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.365557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.365597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.365821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.366030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.366161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c4df4c7-bbd6-4d7e-8f86-963edae8265f" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.582457] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1011.582457] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 1011.583037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.584095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.584095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.584095] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.584445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.584703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.585101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.586152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.586152] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.799022] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.800413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.800511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.800801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.801137] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.801275] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.801375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.801563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.801669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.801762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.802130] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.802130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.802303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.802355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.802502] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.802600] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.802665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.802805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.802882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.802965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.803070] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.963275] env[66854]: INFO networking_nsxv3.common.synchronization [req-70e10d6c-ebfa-40d9-9ce0-7ff7e7c57b9e req-3848afc9-8994-48e8-9884-67313afe468b tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_members [ 1011.965175] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGHEST for action security_group_members [ 1011.965732] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e0f7e9-6f3b-4bea-945c-76f1da468a99 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.965919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.966033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.966345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.966568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.966742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.966823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.967060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.967188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.967330] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.088741] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.306525] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee66d96e-b19b-40e4-b459-52eebc42250e: rpc.has_security_group_logging(os_id): False [ 1012.327437] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.327752] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.327752] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.327837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.327999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.328240] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.328354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.328497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.328617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.328863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.332590] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.332590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.332590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.332590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.332590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.332590] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.332590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.332590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.332590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.332590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.332590] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee66d96e-b19b-40e4-b459-52eebc42250e is going to be created. [ 1012.414364] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.414548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.414599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.414810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.415027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.428293] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: IN_PROGRESS for 2s [ 1012.472754] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.472754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.472754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.473088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.526619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.527066] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.527478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.528829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.529145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.529249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.529408] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 is going to be updated. [ 1012.583743] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.583983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.584390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.584520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.584895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.593037] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.604842] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 in Status: IN_PROGRESS for 2s [ 1012.637225] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1012.637509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.637714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.637955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.640093] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.640093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.640093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.640093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.640093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.640093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.640093] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.096798] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.096981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.097070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.097522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.097698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.098164] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1013.126212] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.126345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.127473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.127473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.127473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.138375] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1013.145393] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.145588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.145660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.145868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.146043] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.146142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.146197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.146346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.146463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.146576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.146819] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.146919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.146978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.147138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.147818] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.147818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.147818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.147818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.147818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.147818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.147818] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.650402] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44b9fe7e-d139-4b46-925d-7947b4b3dac9: rpc.has_security_group_logging(os_id): False [ 1013.670977] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.671230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.671356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.671771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.671815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.672140] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.672276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.672380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.672631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.672769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.673412] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.673611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.673740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.673969] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.674249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.675537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.675537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.675537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.675537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.675537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.675537] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1013.738766] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.738958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.739608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.739608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.739608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.753937] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1013.762585] env[66854]: INFO networking_nsxv3.common.synchronization [req-9e66fbd9-abee-414c-9c15-3d13ec0e2363 req-47e3ed69-5690-4194-b5b4-f5f7e9cab613 tempest-InstanceActionsV221TestJSON-2053327087 tempest-InstanceActionsV221TestJSON-2053327087-project-member] Enqueued Resource ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a with Priority: HIGHEST for action security_group_members [ 1013.763224] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a with Priority: HIGHEST for action security_group_members [ 1013.763524] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.763646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.763705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.763905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.764090] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.764180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.764239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.764395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.764528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.764577] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd8df7a7-7bdc-4ef6-8502-08f458c1982a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.266880] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.266992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.266992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.267239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.267313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.267684] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.267684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.267684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.267897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.267942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.268026] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a is going to be updated. [ 1014.302783] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.302783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.302783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.303055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.303219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.313032] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a in Status: IN_PROGRESS for 2s [ 1014.442274] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: SUCCESS [ 1014.442274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.616608] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 in Status: SUCCESS [ 1014.616848] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 deletion is rescheduled due to dependency. [ 1014.617014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.149849] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1015.150133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.150228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.150445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.150642] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.150764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.150842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.151009] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.151130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.151224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.151324] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.654921] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.655112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.655191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.655472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.655693] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.655798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.655846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.656089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.656179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.656285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.656455] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.656605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.656757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.656823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.657010] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.657746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.657746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.657746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.657746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.657746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.657746] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.777636] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1015.777636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.160394] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab5dfec-4c69-486f-983d-2ea9413eccfa: rpc.has_security_group_logging(os_id): False [ 1016.181427] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.181642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.181642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.181787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.181966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.182117] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.182221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.182284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.182439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.182528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.182723] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.182815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.182876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.183026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.183101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.183364] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.183364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.183530] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.183570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.183620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.183698] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1016.254175] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.254175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.254175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.254175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.254175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.271255] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1016.327129] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a in Status: SUCCESS [ 1016.327318] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a deletion is rescheduled due to dependency. [ 1016.327425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.757880] env[66854]: INFO networking_nsxv3.common.synchronization [None req-bdfa05f7-f7f2-4546-82b7-7b7603ddc469 None None] Enqueued Resource ID: c976e0df-b76f-45ca-ac10-126c85c5a782 with Priority: HIGHEST for action port [ 1016.758149] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c976e0df-b76f-45ca-ac10-126c85c5a782 with Priority: HIGHEST for action port [ 1016.758715] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c976e0df-b76f-45ca-ac10-126c85c5a782 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.758835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c976e0df-b76f-45ca-ac10-126c85c5a782" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.758929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c976e0df-b76f-45ca-ac10-126c85c5a782" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.759199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c976e0df-b76f-45ca-ac10-126c85c5a782" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.759297] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c976e0df-b76f-45ca-ac10-126c85c5a782',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.264151] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c976e0df-b76f-45ca-ac10-126c85c5a782 [ 1017.264471] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.264572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.264572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.265429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.265429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.265429] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c976e0df-b76f-45ca-ac10-126c85c5a782 already deleted. [ 1017.265429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c976e0df-b76f-45ca-ac10-126c85c5a782" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.294540] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1018.294540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.120236] env[66854]: INFO networking_nsxv3.common.synchronization [None req-a80f80d5-227f-4ea0-aa3d-9e3a38aa5a11 None None] Enqueued Resource ID: a1eb8790-98be-4c58-9d23-248abb798697 with Priority: HIGHEST for action port [ 1019.121464] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1eb8790-98be-4c58-9d23-248abb798697 with Priority: HIGHEST for action port [ 1019.121464] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1eb8790-98be-4c58-9d23-248abb798697 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.121464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1eb8790-98be-4c58-9d23-248abb798697" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.121464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1eb8790-98be-4c58-9d23-248abb798697" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.121683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1eb8790-98be-4c58-9d23-248abb798697" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.121715] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1eb8790-98be-4c58-9d23-248abb798697',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.626362] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1eb8790-98be-4c58-9d23-248abb798697 [ 1019.626624] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.626735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.626792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.628093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.628093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.628093] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1eb8790-98be-4c58-9d23-248abb798697 already deleted. [ 1019.628093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1eb8790-98be-4c58-9d23-248abb798697" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.806602] env[66854]: INFO networking_nsxv3.common.synchronization [req-02643c12-057c-4423-8635-b3c28d385abe req-93a3227d-b2cc-451b-a03a-b9c254492706 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 1022.807224] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 1022.807574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.807699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.807764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.808365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.808365] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.808365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.808365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.808677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.808863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.809030] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.313446] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.313684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.313736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.314032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.314153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.314437] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.314552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.314642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.314870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.314962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.315077] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 1023.351462] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.351710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.351832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.352083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.352285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.364967] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 1024.074605] env[66854]: INFO networking_nsxv3.common.synchronization [req-4cc89f61-41dc-4067-a441-34ba4d16c403 req-9f12bf0b-3e8a-4a6a-9d9f-d386abce931f tempest-ListImageFiltersTestJSON-509701154 tempest-ListImageFiltersTestJSON-509701154-project-member] Enqueued Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 1024.075446] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 1024.075901] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.076093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.076223] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.076440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.076629] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.076737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.076803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.076984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.077083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.077187] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.579895] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.082881] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.379523] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 1025.379523] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 deletion is rescheduled due to dependency. [ 1025.379839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.585564] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.586169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.586352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.587321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.587321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.587321] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c84b2-3881-420f-8626-4994a562540b is going to be updated. [ 1025.619278] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.619618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.619618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.619800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.619974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.629933] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: IN_PROGRESS for 2s [ 1027.642904] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: SUCCESS [ 1027.643369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.023419] env[66854]: INFO networking_nsxv3.common.synchronization [req-03e68e87-c829-4e2f-a334-1479a81edc7f req-fc90af82-f97d-4c1d-aab1-99c8e78979c5 tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1029.023419] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1029.024193] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.024491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.024747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.025052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.026668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.026996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.027187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.027457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.027640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.027846] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.504731] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-541 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.505010] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.505446] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.505537] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.505805] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.505987] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.506473] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.506473] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.506631] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.506865] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.507034] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.507166] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.507322] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.507672] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.507672] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.507787] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.531378] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.531599] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.532071] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.532281] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.532723] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-02b46e15-bbd4-474a-b194-2cc27808edd3 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.532905] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-02b46e15-bbd4-474a-b194-2cc27808edd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.534052] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-02b46e15-bbd4-474a-b194-2cc27808edd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.534052] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-02b46e15-bbd4-474a-b194-2cc27808edd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.534052] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02b46e15-bbd4-474a-b194-2cc27808edd3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.534552] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.036636] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.037063] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.037138] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.037507] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.037738] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.037923] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 02b46e15-bbd4-474a-b194-2cc27808edd3 not found, creating... [ 1030.038329] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.038537] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.038686] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.038995] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.039268] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.039628] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.039831] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.039982] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.040341] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.040526] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.040708] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 02b46e15-bbd4-474a-b194-2cc27808edd3 is going to be created. [ 1030.042027] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.065089] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.065344] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.065498] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.065808] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.066202] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.066499] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-02b46e15-bbd4-474a-b194-2cc27808edd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.544928] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.545285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.545285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.545474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.545564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.545764] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1030.585480] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.585728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.585851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.586130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.586326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.600295] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1030.844272] env[66854]: INFO networking_nsxv3.common.synchronization [req-03e68e87-c829-4e2f-a334-1479a81edc7f req-92644f8f-a4e8-4b80-bcb8-ecfcf271f1ba service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 1030.844462] env[66854]: INFO networking_nsxv3.common.synchronization [req-03e68e87-c829-4e2f-a334-1479a81edc7f req-92644f8f-a4e8-4b80-bcb8-ecfcf271f1ba service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1030.844601] env[66854]: INFO networking_nsxv3.common.synchronization [req-03e68e87-c829-4e2f-a334-1479a81edc7f req-92644f8f-a4e8-4b80-bcb8-ecfcf271f1ba service nova] Enqueued Resource ID: 02b46e15-bbd4-474a-b194-2cc27808edd3 with Priority: HIGHEST for action port [ 1030.846653] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 1030.846653] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1030.846653] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b46e15-bbd4-474a-b194-2cc27808edd3 with Priority: HIGHEST for action port [ 1030.846653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.846653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.846653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.846653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.846653] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.847664] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.847760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.851023] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-02b46e15-bbd4-474a-b194-2cc27808edd3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.851023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02b46e15-bbd4-474a-b194-2cc27808edd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.851023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02b46e15-bbd4-474a-b194-2cc27808edd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.851023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02b46e15-bbd4-474a-b194-2cc27808edd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.851023] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02b46e15-bbd4-474a-b194-2cc27808edd3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.350817] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.351374] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.351374] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02b46e15-bbd4-474a-b194-2cc27808edd3 with status ACTIVE [ 1031.351374] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.351557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.351557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.351813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.351813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.352711] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.352711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.352711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.352711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.352711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.352711] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.352711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.353217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.353217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.353217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.353217] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02b46e15-bbd4-474a-b194-2cc27808edd3 is going to be updated. [ 1031.387889] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.388150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.388211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.388545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.388753] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.388989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02b46e15-bbd4-474a-b194-2cc27808edd3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.111417] env[66854]: INFO networking_nsxv3.common.synchronization [None req-b8f3dd5e-7b67-4c8f-a904-33aa71389438 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_rules [ 1032.112164] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_rules [ 1032.112286] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-845b53d6-5efd-417e-be55-cf8d579b97a7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.112769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.112769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.112769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.112962] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.225013] env[66854]: INFO networking_nsxv3.common.synchronization [None req-d5e2448f-846a-42b5-8d9b-6b86d4c45e0d tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_rules [ 1032.225537] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_rules [ 1032.226115] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-845b53d6-5efd-417e-be55-cf8d579b97a7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.226115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.612815] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1032.613262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.613310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.613510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.613772] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.613902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.613975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.614192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.614275] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.614358] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.642067] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.642304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.642446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.642738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.642883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.643873] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 already deleted. [ 1032.644044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.644393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.648023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.648023] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.121409] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.171090] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.171319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.171319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.171711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.171858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.171972] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 already deleted. [ 1033.172126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.624027] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.126528] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.126757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.126757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.126978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.127100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.127212] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1034.160083] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.160322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.160322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.160495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.160659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.171051] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1035.303578] env[66854]: INFO networking_nsxv3.common.synchronization [req-2f3ce98f-26a5-4945-9f26-0ef27ab59b7d req-d9ede7e4-4bab-47de-a97f-f239cff8add4 tempest-AttachInterfacesV270Test-404307023 tempest-AttachInterfacesV270Test-404307023-project-member] Enqueued Resource ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 with Priority: HIGHEST for action security_group_members [ 1035.304318] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 with Priority: HIGHEST for action security_group_members [ 1035.304526] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-97e4bb3e-c69c-45a4-812a-564327f5ba24 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.304723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.304770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.305109] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.305251] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.305338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.305419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.305708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.305708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.305829] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97e4bb3e-c69c-45a4-812a-564327f5ba24',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.509529] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1035.509766] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:2 started [ 1035.722540] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-213 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.722837] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-213" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.723388] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-213" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.723388] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-213" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.723602] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.723800] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.724299] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.724299] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.724299] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.724519] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.724913] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.724913] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.724913] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.725078] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.725078] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.725171] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.748234] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.748481] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1035.748481] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.748618] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-213" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.748984] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-c1fabb11-24f0-430a-9e5f-e39ca11726f9 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.750277] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-c1fabb11-24f0-430a-9e5f-e39ca11726f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.750277] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-c1fabb11-24f0-430a-9e5f-e39ca11726f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.750277] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-c1fabb11-24f0-430a-9e5f-e39ca11726f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.750277] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1fabb11-24f0-430a-9e5f-e39ca11726f9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.809109] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.809273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.809344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.809551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.809645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.809875] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.809977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.810052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.810205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.810294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.810382] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 already deleted. [ 1035.810476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.184396] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1036.184617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.184795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.185044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.185247] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.185366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.185815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.185815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.185815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.185815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.185998] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.254230] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.256883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.256883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.256883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.256883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.256883] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port c1fabb11-24f0-430a-9e5f-e39ca11726f9 not found, creating... [ 1036.256883] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.256883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.256883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.256883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.256883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.257575] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.257575] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.257575] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.257575] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.257575] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.257575] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: c1fabb11-24f0-430a-9e5f-e39ca11726f9 is going to be created. [ 1036.277990] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.278275] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.278417] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.278744] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.279030] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.279275] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-c1fabb11-24f0-430a-9e5f-e39ca11726f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.687902] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.688325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.688325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.688485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.688684] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.688792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.688857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.689442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.689442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.689442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.689442] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.689442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.689694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.691056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.691056] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.691056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.691056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.691056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.691056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.691056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.691056] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.001543] env[66854]: INFO networking_nsxv3.common.synchronization [req-2f3ce98f-26a5-4945-9f26-0ef27ab59b7d req-05167ec6-bc20-44b7-bae5-f03e16695cf5 service nova] Enqueued Resource ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 with Priority: HIGHEST for action security_group_rules [ 1037.001815] env[66854]: INFO networking_nsxv3.common.synchronization [req-2f3ce98f-26a5-4945-9f26-0ef27ab59b7d req-05167ec6-bc20-44b7-bae5-f03e16695cf5 service nova] Enqueued Resource ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 with Priority: HIGHEST for action security_group_members [ 1037.002030] env[66854]: INFO networking_nsxv3.common.synchronization [req-2f3ce98f-26a5-4945-9f26-0ef27ab59b7d req-05167ec6-bc20-44b7-bae5-f03e16695cf5 service nova] Enqueued Resource ID: c1fabb11-24f0-430a-9e5f-e39ca11726f9 with Priority: HIGHEST for action port [ 1037.003125] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 with Priority: HIGHEST for action security_group_rules [ 1037.003471] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 with Priority: HIGHEST for action security_group_members [ 1037.003609] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1fabb11-24f0-430a-9e5f-e39ca11726f9 with Priority: HIGHEST for action port [ 1037.004250] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97e4bb3e-c69c-45a4-812a-564327f5ba24 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.004487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.004653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.005115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.005283] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97e4bb3e-c69c-45a4-812a-564327f5ba24',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.009478] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-97e4bb3e-c69c-45a4-812a-564327f5ba24 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.009635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.009736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.010037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.010257] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.010400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.010503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.010733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.010843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.010952] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97e4bb3e-c69c-45a4-812a-564327f5ba24',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.014738] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1fabb11-24f0-430a-9e5f-e39ca11726f9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.014738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1fabb11-24f0-430a-9e5f-e39ca11726f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.014738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1fabb11-24f0-430a-9e5f-e39ca11726f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.015428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1fabb11-24f0-430a-9e5f-e39ca11726f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.015503] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1fabb11-24f0-430a-9e5f-e39ca11726f9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.193561] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6779288d-3538-4416-9c3b-5f739846d8f3: rpc.has_security_group_logging(os_id): False [ 1037.217557] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.217795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.217795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.218022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.218125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.218362] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.218480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.218525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.218695] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.218799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.218992] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.219103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.219168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.219327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.219387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.219569] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.219664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.219721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.219860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.219933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.220098] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1037.318596] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.318854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.318973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.319226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.319387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.334377] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1037.510225] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-97e4bb3e-c69c-45a4-812a-564327f5ba24 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.510225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.518320] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97e4bb3e-c69c-45a4-812a-564327f5ba24',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.519382] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1fabb11-24f0-430a-9e5f-e39ca11726f9 with status ACTIVE [ 1037.519586] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.519765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.519765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.520092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.520155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.520387] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.520756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.520756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.520756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.520756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.523291] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.523345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.523439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.523597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.523661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.523747] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1fabb11-24f0-430a-9e5f-e39ca11726f9 is going to be updated. [ 1037.547763] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.547942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.548058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.548303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.548481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.548665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1fabb11-24f0-430a-9e5f-e39ca11726f9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.938890] env[66854]: INFO networking_nsxv3.common.synchronization [req-c326cd1c-f664-42c7-b5a9-824825b649b9 req-ce633784-57dd-44f1-a5a8-1b163ad39b78 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 1037.939462] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 1037.939772] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.939891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.939959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.940174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.940326] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.940425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.940500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.940668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.940788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.940938] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.026847] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97e4bb3e-c69c-45a4-812a-564327f5ba24',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.370545] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.370899] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.370899] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.371296] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.371601] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.372043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.372043] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.372795] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.372841] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.373341] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.373388] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.373491] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.373603] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.373716] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.373820] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.373957] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.397178] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.397178] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.397178] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.397300] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-868" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.397644] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-cc595151-76b8-4b81-94de-028ea75c65d3 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.397893] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-cc595151-76b8-4b81-94de-028ea75c65d3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.397893] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-cc595151-76b8-4b81-94de-028ea75c65d3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.398217] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-cc595151-76b8-4b81-94de-028ea75c65d3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.398378] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc595151-76b8-4b81-94de-028ea75c65d3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.443071] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.443244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.443299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.443528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.443579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.443786] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.443859] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.443915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.444057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.444138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.444225] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 1038.476134] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.476235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.476299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.476496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.476646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.487227] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 1038.529841] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.529841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.529841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.530060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.530096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.531025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 is going to be created. [ 1038.553622] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.553778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.553822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.554184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.554184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.563193] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 in Status: UNINITIALIZED for 2s [ 1038.902196] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.902474] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.902613] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.902961] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.903188] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.903361] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port cc595151-76b8-4b81-94de-028ea75c65d3 not found, creating... [ 1038.903631] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.903811] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.903927] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.904206] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.904344] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.904628] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.904778] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.904892] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.905110] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.905245] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.905384] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: cc595151-76b8-4b81-94de-028ea75c65d3 is going to be created. [ 1038.928546] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.928771] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.928984] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.929277] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.929511] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.929743] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-cc595151-76b8-4b81-94de-028ea75c65d3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.355289] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1039.355289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.663311] env[66854]: INFO networking_nsxv3.common.synchronization [req-c326cd1c-f664-42c7-b5a9-824825b649b9 req-f8de7636-8dcd-4dd8-afe7-0b9f38ba6faa service nova] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_rules [ 1039.663517] env[66854]: INFO networking_nsxv3.common.synchronization [req-c326cd1c-f664-42c7-b5a9-824825b649b9 req-f8de7636-8dcd-4dd8-afe7-0b9f38ba6faa service nova] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 1039.663660] env[66854]: INFO networking_nsxv3.common.synchronization [req-c326cd1c-f664-42c7-b5a9-824825b649b9 req-f8de7636-8dcd-4dd8-afe7-0b9f38ba6faa service nova] Enqueued Resource ID: cc595151-76b8-4b81-94de-028ea75c65d3 with Priority: HIGHEST for action port [ 1039.664245] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_rules [ 1039.664389] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 1039.664510] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc595151-76b8-4b81-94de-028ea75c65d3 with Priority: HIGHEST for action port [ 1039.664789] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.664909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.664989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.668222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.668319] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.669347] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.669472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.669695] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc595151-76b8-4b81-94de-028ea75c65d3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.670074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc595151-76b8-4b81-94de-028ea75c65d3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.670211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc595151-76b8-4b81-94de-028ea75c65d3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.671237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc595151-76b8-4b81-94de-028ea75c65d3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.671237] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc595151-76b8-4b81-94de-028ea75c65d3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.172795] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.172944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.173325] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc595151-76b8-4b81-94de-028ea75c65d3 with status ACTIVE [ 1040.173399] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.173522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.173587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.173798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.174571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.174571] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.174571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.174571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.174571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.174571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.174871] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.174871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.174871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.174871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.175009] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.175009] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc595151-76b8-4b81-94de-028ea75c65d3 is going to be updated. [ 1040.199034] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.199034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.199034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.199034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.199034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.199034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc595151-76b8-4b81-94de-028ea75c65d3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.500111] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 1040.500360] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 deletion is rescheduled due to dependency. [ 1040.500360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.500521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.500765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.500959] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.501144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.501206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.501355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.501437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.501537] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.544212] env[66854]: INFO networking_nsxv3.common.synchronization [req-e564b126-d291-46e8-a3bf-0fe5bc5edc9e req-aa62a2f2-cbf2-463f-a0d9-363eff89d825 tempest-ServerDiagnosticsNegativeTest-989293408 tempest-ServerDiagnosticsNegativeTest-989293408-project-member] Enqueued Resource ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 with Priority: HIGHEST for action security_group_members [ 1040.544212] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 with Priority: HIGHEST for action security_group_members [ 1040.544212] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1308feff-f29c-49ab-ba49-67f2be7bd392 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.544212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.544212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.544212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.544212] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.544212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.544212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.544212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.544212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.544650] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1308feff-f29c-49ab-ba49-67f2be7bd392',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.572846] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 in Status: SUCCESS [ 1040.573053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.573469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.573742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.573942] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.574347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.574432] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.574596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.574677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.574771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.575010] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97e4bb3e-c69c-45a4-812a-564327f5ba24',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.908560] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.908855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.909408] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.909487] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.909874] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.910139] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.910304] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.911730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.911730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.911730] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.911730] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.911730] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.911730] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.912344] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.912344] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.912344] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.932375] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.932617] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1040.932716] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.932882] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-258" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.933224] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-ade09f3d-c7aa-4862-8595-7ea0114cbe53 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.933404] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-ade09f3d-c7aa-4862-8595-7ea0114cbe53" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.933524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-ade09f3d-c7aa-4862-8595-7ea0114cbe53" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.934089] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-ade09f3d-c7aa-4862-8595-7ea0114cbe53" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.934089] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ade09f3d-c7aa-4862-8595-7ea0114cbe53',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.004677] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.047352] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.047561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.047622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.047847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.047939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.048163] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.048271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.048330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.048483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.048574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.048668] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 already deleted. [ 1041.048760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.077309] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-97e4bb3e-c69c-45a4-812a-564327f5ba24 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.077637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.077778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.078145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.078410] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.078578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.078692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.078947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.079149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.079300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.079800] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-97e4bb3e-c69c-45a4-812a-564327f5ba24 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.079800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.079800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.080023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.080164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.080261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.080326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.080477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.080630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.080675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.080764] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97e4bb3e-c69c-45a4-812a-564327f5ba24',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.437647] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.437875] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.438011] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.438365] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.438460] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.438806] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port ade09f3d-c7aa-4862-8595-7ea0114cbe53 not found, creating... [ 1041.438918] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.439177] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.439239] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.439586] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.440370] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.440370] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.440532] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.440762] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.440969] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.441139] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.441358] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: ade09f3d-c7aa-4862-8595-7ea0114cbe53 is going to be created. [ 1041.466065] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.466065] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.466065] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.466065] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.466065] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.466065] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-ade09f3d-c7aa-4862-8595-7ea0114cbe53" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.507157] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.583389] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97e4bb3e-c69c-45a4-812a-564327f5ba24: rpc.has_security_group_logging(os_id): False [ 1041.607072] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.610117] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.610117] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.610117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.610905] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.610905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.610905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.610905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.610905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.610905] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 is going to be created. [ 1041.677416] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.677664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.677664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.678353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.678353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.688948] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 in Status: IN_PROGRESS for 2s [ 1042.009830] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.010063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.010334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.010425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.010517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.010625] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 1042.054311] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.054311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.054311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.054311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.054598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.068865] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 1042.719041] env[66854]: INFO networking_nsxv3.common.synchronization [req-e564b126-d291-46e8-a3bf-0fe5bc5edc9e req-fe8df38e-eac9-4ec6-9047-d5daec66f10e service nova] Enqueued Resource ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 with Priority: HIGHEST for action security_group_rules [ 1042.721071] env[66854]: INFO networking_nsxv3.common.synchronization [req-e564b126-d291-46e8-a3bf-0fe5bc5edc9e req-fe8df38e-eac9-4ec6-9047-d5daec66f10e service nova] Enqueued Resource ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 with Priority: HIGHEST for action security_group_members [ 1042.721071] env[66854]: INFO networking_nsxv3.common.synchronization [req-e564b126-d291-46e8-a3bf-0fe5bc5edc9e req-fe8df38e-eac9-4ec6-9047-d5daec66f10e service nova] Enqueued Resource ID: ade09f3d-c7aa-4862-8595-7ea0114cbe53 with Priority: HIGHEST for action port [ 1042.721896] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 with Priority: HIGHEST for action security_group_rules [ 1042.722100] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 with Priority: HIGHEST for action security_group_members [ 1042.722242] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ade09f3d-c7aa-4862-8595-7ea0114cbe53 with Priority: HIGHEST for action port [ 1042.722676] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1308feff-f29c-49ab-ba49-67f2be7bd392 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.723330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.723439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.723786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.723906] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1308feff-f29c-49ab-ba49-67f2be7bd392',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.726709] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1308feff-f29c-49ab-ba49-67f2be7bd392 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.726858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.727054] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.729177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.729177] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.729177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.729177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.729177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.729177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.729177] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1308feff-f29c-49ab-ba49-67f2be7bd392',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.729615] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-ade09f3d-c7aa-4862-8595-7ea0114cbe53 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.731919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ade09f3d-c7aa-4862-8595-7ea0114cbe53" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.731919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ade09f3d-c7aa-4862-8595-7ea0114cbe53" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.731919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ade09f3d-c7aa-4862-8595-7ea0114cbe53" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.732750] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ade09f3d-c7aa-4862-8595-7ea0114cbe53',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.233985] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1308feff-f29c-49ab-ba49-67f2be7bd392 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.234244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.234425] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1308feff-f29c-49ab-ba49-67f2be7bd392',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.235561] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ade09f3d-c7aa-4862-8595-7ea0114cbe53 with status ACTIVE [ 1043.235561] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.235832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.235832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.235933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.236043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.236219] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.236320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.236378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.236539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.236615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.241977] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.241977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.241977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.241977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.243565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.243565] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ade09f3d-c7aa-4862-8595-7ea0114cbe53 is going to be updated. [ 1043.269674] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.269870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.269948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.270294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.270409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.270505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ade09f3d-c7aa-4862-8595-7ea0114cbe53" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.703861] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 in Status: SUCCESS [ 1043.704341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.746038] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1308feff-f29c-49ab-ba49-67f2be7bd392',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.080709] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 1044.080946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.081127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.081355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.081689] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.081839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.081918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.082111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.082191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.082288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.082382] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.248782] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.249013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.249013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.249252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.249482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.249616] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 is going to be created. [ 1044.277768] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.278068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.278196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.278513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.278823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.290392] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 in Status: UNINITIALIZED for 2s [ 1044.584866] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.585051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.585132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.585366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.585537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.585744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.585744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.585856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.585948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.586014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.586172] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.586265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.586328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.586461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.586602] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.586692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.586761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.586884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.586959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.587052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.587142] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.761739] env[66854]: INFO networking_nsxv3.common.synchronization [req-e7c6103d-3fdd-4ae6-885c-e8fb469b29d9 req-3179bb3c-2904-4b1e-906e-c69cf555071e tempest-ServerRescueTestJSON-1131573559 tempest-ServerRescueTestJSON-1131573559-project-member] Enqueued Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1044.766024] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1044.766024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.766024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.766024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.766024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.766024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.766024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.766024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.766024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.766024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.766024] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.051971] env[66854]: INFO networking_nsxv3.common.synchronization [req-66e9a179-4a2d-467b-b35a-d355d979ca12 req-50d8c75d-d57f-4201-86cd-8421403c1981 tempest-ListImageFiltersTestJSON-509701154 tempest-ListImageFiltersTestJSON-509701154-project-member] Enqueued Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 1045.051971] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGHEST for action security_group_members [ 1045.052219] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.052998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.052998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.052998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.052998] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.052998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.053237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.053237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.053314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.053473] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.091256] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ccc5a4-8c8a-445b-b37a-462c691c3639: rpc.has_security_group_logging(os_id): False [ 1045.116854] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.117112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.117112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.117285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.117408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.117580] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.117742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.117742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.118100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.118100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.118194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.118259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.118306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.118504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.118588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.118779] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.118867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.119122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.119122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.119240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.119352] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 1045.163017] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.163236] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-529" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.163368] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-529" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.163644] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-529" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.163953] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.164124] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.164264] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.164492] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.164650] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.164888] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.165016] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.165146] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.165262] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.165379] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.165485] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.165620] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.190215] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.190451] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1045.190602] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.190784] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-529" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.191156] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-4169c0fa-0b4d-4e34-a869-4e7744369452 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.191421] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-4169c0fa-0b4d-4e34-a869-4e7744369452" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.191560] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-4169c0fa-0b4d-4e34-a869-4e7744369452" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.191901] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-4169c0fa-0b4d-4e34-a869-4e7744369452" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.192060] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4169c0fa-0b4d-4e34-a869-4e7744369452',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.209661] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.209815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.210296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.210296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.210296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.227898] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 1045.270562] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.477663] env[66854]: INFO networking_nsxv3.common.synchronization [req-d66c4d3f-ed3f-4696-add0-bcf41899dd78 req-89a78c56-a635-48e1-ab10-ff015f2a63e0 tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1045.478258] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1045.478628] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.478760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.478830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.479057] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.479236] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.479370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.479472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.479653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.479744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.479843] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.559151] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.559348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.559423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.559635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.559732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.559934] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.560048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.560113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.560268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.560346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.560434] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c84b2-3881-420f-8626-4994a562540b is going to be updated. [ 1045.607399] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.607399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.607399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.607538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.607570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.616243] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: IN_PROGRESS for 2s [ 1045.694556] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.694794] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.694925] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.695238] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.695430] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.695604] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 4169c0fa-0b4d-4e34-a869-4e7744369452 not found, creating... [ 1045.695872] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.696055] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.696179] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.696424] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.696570] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.696879] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.697074] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.697174] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.697438] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.697521] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.697669] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 4169c0fa-0b4d-4e34-a869-4e7744369452 is going to be created. [ 1045.728246] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.728521] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.728654] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.728925] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.729184] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.729407] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-4169c0fa-0b4d-4e34-a869-4e7744369452" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.772537] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.981476] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.275010] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.275259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.275310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.276179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.276179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.276179] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee66d96e-b19b-40e4-b459-52eebc42250e is going to be updated. [ 1046.312234] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 in Status: SUCCESS [ 1046.312479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.312612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.312862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.313111] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.313237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.313294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.313465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.313592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.313650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.313763] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1308feff-f29c-49ab-ba49-67f2be7bd392',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.318574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.318721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.318786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.318976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.319155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.329357] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: IN_PROGRESS for 2s [ 1046.485771] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.493313] env[66854]: INFO networking_nsxv3.common.synchronization [req-e7c6103d-3fdd-4ae6-885c-e8fb469b29d9 req-f9e600ae-0ae8-408c-bfa6-388f1cac0829 service nova] Enqueued Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_rules [ 1046.493498] env[66854]: INFO networking_nsxv3.common.synchronization [req-e7c6103d-3fdd-4ae6-885c-e8fb469b29d9 req-f9e600ae-0ae8-408c-bfa6-388f1cac0829 service nova] Enqueued Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1046.493649] env[66854]: INFO networking_nsxv3.common.synchronization [req-e7c6103d-3fdd-4ae6-885c-e8fb469b29d9 req-f9e600ae-0ae8-408c-bfa6-388f1cac0829 service nova] Enqueued Resource ID: 4169c0fa-0b4d-4e34-a869-4e7744369452 with Priority: HIGHEST for action port [ 1046.494237] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_rules [ 1046.494400] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1046.494523] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4169c0fa-0b4d-4e34-a869-4e7744369452 with Priority: HIGHEST for action port [ 1046.494847] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.494990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.497869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.498129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.498251] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.499259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.499367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.499910] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4169c0fa-0b4d-4e34-a869-4e7744369452 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.500047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4169c0fa-0b4d-4e34-a869-4e7744369452" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.500090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4169c0fa-0b4d-4e34-a869-4e7744369452" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.500552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4169c0fa-0b4d-4e34-a869-4e7744369452" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.500552] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4169c0fa-0b4d-4e34-a869-4e7744369452',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.816077] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1308feff-f29c-49ab-ba49-67f2be7bd392 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.816077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.816077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.816077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.816613] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.816613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.816613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.816613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.816828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.816828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.816896] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1308feff-f29c-49ab-ba49-67f2be7bd392 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.816944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.817030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.817166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.817310] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.817391] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.817453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.817588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.817662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.817744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.817834] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1308feff-f29c-49ab-ba49-67f2be7bd392',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.989089] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.989217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.989293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.989553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.989710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.989914] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1047.002248] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.002963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.003181] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4169c0fa-0b4d-4e34-a869-4e7744369452 with status ACTIVE [ 1047.003360] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.003484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.003570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.003756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.003846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.004033] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.004134] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.004197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.004353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.004432] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.004604] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.005016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.005016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.005016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.005016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.005016] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4169c0fa-0b4d-4e34-a869-4e7744369452 is going to be updated. [ 1047.022486] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.022486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.022486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.022756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.022799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.030465] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.030589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.030589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.030770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.030904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.031105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4169c0fa-0b4d-4e34-a869-4e7744369452" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.035476] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1047.217077] env[66854]: INFO networking_nsxv3.common.synchronization [req-8342e310-5605-4f65-a167-2ec9e88d7c29 req-1b9c72a4-79f6-4d1b-b986-b91e78a97beb tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_members [ 1047.217745] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_members [ 1047.218064] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-845b53d6-5efd-417e-be55-cf8d579b97a7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.218482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.218482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.218482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.218630] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.218724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.218785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.219165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.219292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.219414] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.241793] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 1047.242016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.320485] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1308feff-f29c-49ab-ba49-67f2be7bd392: rpc.has_security_group_logging(os_id): False [ 1047.363201] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.363611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.363611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.363914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.364131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.364579] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.364719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.364840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.365200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.365396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.365791] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.365999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.366161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.366432] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.366603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.366914] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.367103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.367238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.367476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.367644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.367730] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 is going to be created. [ 1047.463030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.463030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.463030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.463030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.463030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.479681] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 in Status: IN_PROGRESS for 2s [ 1047.629181] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c84b2-3881-420f-8626-4994a562540b in Status: SUCCESS [ 1047.629855] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c84b2-3881-420f-8626-4994a562540b deletion is rescheduled due to dependency. [ 1047.629855] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.724327] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.724488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.724589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.724764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.724852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.725088] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.725197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.725278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.725404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.725457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.725512] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 already deleted. [ 1047.725605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.726793] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.726974] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.727110] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.727338] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.727581] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.727733] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.727849] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.728400] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.728578] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.728794] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.728911] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.729046] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.729210] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.729335] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.729445] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.729578] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.750320] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.750516] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1047.750689] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.750965] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.751264] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-d65e3fdf-9758-4f60-a012-771576d19122 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.751469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-d65e3fdf-9758-4f60-a012-771576d19122" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.751662] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-d65e3fdf-9758-4f60-a012-771576d19122" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.751979] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-d65e3fdf-9758-4f60-a012-771576d19122" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.752191] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d65e3fdf-9758-4f60-a012-771576d19122',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.256476] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.256855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.256855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.257017] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.257187] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.257341] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port d65e3fdf-9758-4f60-a012-771576d19122 not found, creating... [ 1048.257606] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.257760] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.257872] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.258163] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.258263] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.258550] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.258698] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.258811] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.259113] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.259249] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.259379] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: d65e3fdf-9758-4f60-a012-771576d19122 is going to be created. [ 1048.279763] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.279938] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.279938] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.280270] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.280509] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.280737] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-d65e3fdf-9758-4f60-a012-771576d19122" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.348050] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: SUCCESS [ 1048.348304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.348542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.348773] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.348964] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.349183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.349594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.349594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.349594] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.349594] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.853161] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.972289] env[66854]: INFO networking_nsxv3.common.synchronization [req-8342e310-5605-4f65-a167-2ec9e88d7c29 req-b84f0168-3e35-45fd-b4db-0470fae29772 service nova] Enqueued Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_rules [ 1048.972472] env[66854]: INFO networking_nsxv3.common.synchronization [req-8342e310-5605-4f65-a167-2ec9e88d7c29 req-b84f0168-3e35-45fd-b4db-0470fae29772 service nova] Enqueued Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_members [ 1048.972659] env[66854]: INFO networking_nsxv3.common.synchronization [req-8342e310-5605-4f65-a167-2ec9e88d7c29 req-b84f0168-3e35-45fd-b4db-0470fae29772 service nova] Enqueued Resource ID: d65e3fdf-9758-4f60-a012-771576d19122 with Priority: HIGHEST for action port [ 1048.973178] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_rules [ 1048.973334] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_members [ 1048.973428] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d65e3fdf-9758-4f60-a012-771576d19122 with Priority: HIGHEST for action port [ 1048.974424] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-845b53d6-5efd-417e-be55-cf8d579b97a7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.974575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.974654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.974849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.974936] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.976424] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-845b53d6-5efd-417e-be55-cf8d579b97a7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.976424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.976424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.976424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.976971] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.976971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.976971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.977684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.977684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.977684] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.978151] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-d65e3fdf-9758-4f60-a012-771576d19122 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.978313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d65e3fdf-9758-4f60-a012-771576d19122" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.978313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d65e3fdf-9758-4f60-a012-771576d19122" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.978463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d65e3fdf-9758-4f60-a012-771576d19122" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.978533] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d65e3fdf-9758-4f60-a012-771576d19122',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.046677] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1049.046890] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.355390] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.480819] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.482091] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-845b53d6-5efd-417e-be55-cf8d579b97a7 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.482091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.482254] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d65e3fdf-9758-4f60-a012-771576d19122 with status ACTIVE [ 1049.482254] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.482254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.482254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.482254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.482254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.483178] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.483178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.483931] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.484244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.484244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.484847] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.484847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.484847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.485040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.487508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.487508] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d65e3fdf-9758-4f60-a012-771576d19122 is going to be updated. [ 1049.501712] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 in Status: SUCCESS [ 1049.501712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.512959] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.512959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.512959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.512959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.512959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.512959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d65e3fdf-9758-4f60-a012-771576d19122" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.683976] env[66854]: INFO networking_nsxv3.common.synchronization [req-4aa278d5-61cf-4019-a185-85f5981cbc7c req-e7ee436f-2712-486b-b0fd-ab4569c9c764 tempest-ImagesTestJSON-1862869845 tempest-ImagesTestJSON-1862869845-project-member] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1049.684576] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1049.684870] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.684983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.685094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.685293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.685448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.685548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.685612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.685790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.685887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.685969] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.858111] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.858284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.858358] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.858574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.858665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.858768] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee66d96e-b19b-40e4-b459-52eebc42250e is going to be updated. [ 1049.885499] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.885693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.885782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.886033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.886196] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.898039] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: IN_PROGRESS for 2s [ 1049.988726] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.993279] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.993649] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.993649] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.993996] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.994434] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.994521] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.994660] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.994855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.995032] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.995220] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.995434] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.995434] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.995537] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.995787] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.995787] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.995923] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.016039] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.016294] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1050.016494] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.016683] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.016994] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-a3c5955c-0dee-44e5-b759-de8ea2fdf09c taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.017186] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-a3c5955c-0dee-44e5-b759-de8ea2fdf09c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.017306] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-a3c5955c-0dee-44e5-b759-de8ea2fdf09c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.017625] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-a3c5955c-0dee-44e5-b759-de8ea2fdf09c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.017786] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3c5955c-0dee-44e5-b759-de8ea2fdf09c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.192103] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.490933] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.491390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.491390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.491390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.491620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.491620] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 is going to be created. [ 1050.520419] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.520763] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.520865] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.521139] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.521292] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.521450] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port a3c5955c-0dee-44e5-b759-de8ea2fdf09c not found, creating... [ 1050.521743] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.521932] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.522068] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.522380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.522554] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.522900] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.523099] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.523184] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.523378] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.523511] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.523653] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: a3c5955c-0dee-44e5-b759-de8ea2fdf09c is going to be created. [ 1050.525528] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.525706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.525706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.526015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.526178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.536866] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 in Status: UNINITIALIZED for 2s [ 1050.547843] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.548126] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.548230] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.548675] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.548908] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.549194] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-a3c5955c-0dee-44e5-b759-de8ea2fdf09c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.694275] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.197519] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.197700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.197804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.198415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.198415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.198415] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1051.235845] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.236056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.236128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.236339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.236492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.249941] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1051.298275] env[66854]: INFO networking_nsxv3.common.synchronization [req-4aa278d5-61cf-4019-a185-85f5981cbc7c req-410675d2-3c59-43ce-ae16-874bfeb852a9 service nova] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_rules [ 1051.298975] env[66854]: INFO networking_nsxv3.common.synchronization [req-4aa278d5-61cf-4019-a185-85f5981cbc7c req-410675d2-3c59-43ce-ae16-874bfeb852a9 service nova] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1051.298975] env[66854]: INFO networking_nsxv3.common.synchronization [req-4aa278d5-61cf-4019-a185-85f5981cbc7c req-410675d2-3c59-43ce-ae16-874bfeb852a9 service nova] Enqueued Resource ID: a3c5955c-0dee-44e5-b759-de8ea2fdf09c with Priority: HIGHEST for action port [ 1051.302997] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_rules [ 1051.302997] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1051.302997] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5955c-0dee-44e5-b759-de8ea2fdf09c with Priority: HIGHEST for action port [ 1051.302997] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.302997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.302997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.302997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.302997] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.302997] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.306754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.306754] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3c5955c-0dee-44e5-b759-de8ea2fdf09c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.306754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3c5955c-0dee-44e5-b759-de8ea2fdf09c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.306754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3c5955c-0dee-44e5-b759-de8ea2fdf09c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.306754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3c5955c-0dee-44e5-b759-de8ea2fdf09c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.306754] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3c5955c-0dee-44e5-b759-de8ea2fdf09c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.808602] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.808925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.808967] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3c5955c-0dee-44e5-b759-de8ea2fdf09c with status ACTIVE [ 1051.809532] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.809532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.809532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.809709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.809709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.809933] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.810102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.810192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.810380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.810486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.810720] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.810813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.810942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.811092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.811197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.811306] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3c5955c-0dee-44e5-b759-de8ea2fdf09c is going to be updated. [ 1051.834771] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.834925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.834973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.835164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.835316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.835480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3c5955c-0dee-44e5-b759-de8ea2fdf09c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.914243] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: SUCCESS [ 1051.914497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.915113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.915113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.915113] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.915113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.915277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.915313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.915390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.915481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.915576] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.421837] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.421837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.421837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.421837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.421837] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.421837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.421837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.421837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.421837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.421837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.421837] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.421837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.422451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.424381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.424381] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.424381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.424381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.424381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.424381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.424381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.424381] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.459185] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.459185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.459185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.459185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.459185] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.549463] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 in Status: SUCCESS [ 1052.549698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.549880] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.550130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.550358] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.550502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.550568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.550913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.551031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.551827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.551827] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.761193] env[66854]: INFO networking_nsxv3.common.synchronization [req-774517da-6877-4dac-afe3-4e0d004253a1 req-365b4027-a1e3-4e67-aadc-750738546d77 tempest-AttachInterfacesV270Test-404307023 tempest-AttachInterfacesV270Test-404307023-project-member] Enqueued Resource ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 with Priority: HIGHEST for action security_group_members [ 1052.761823] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 with Priority: HIGHEST for action security_group_members [ 1052.762319] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-97e4bb3e-c69c-45a4-812a-564327f5ba24 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.762319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.762544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.762619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.762831] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.762944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.763016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.763187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.763262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.763361] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97e4bb3e-c69c-45a4-812a-564327f5ba24',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.926441] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee66d96e-b19b-40e4-b459-52eebc42250e: rpc.has_security_group_logging(os_id): False [ 1052.945389] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.945607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.945652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.945872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.945971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.946196] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.946296] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.946356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.946522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.946612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.946930] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.946930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.947065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.947155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.947207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.947382] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.947465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.947526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.947660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.947736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.947822] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee66d96e-b19b-40e4-b459-52eebc42250e is going to be updated. [ 1052.964608] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.014751] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.014945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.014989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.015214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.015386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.031766] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: IN_PROGRESS for 2s [ 1053.054682] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.140887] env[66854]: INFO networking_nsxv3.common.synchronization [req-4390b05c-f437-4786-8c44-669a34ce1599 req-6aef8fae-3d69-4574-b36e-0dbe10fdae71 tempest-ServerDiskConfigTestJSON-1883021162 tempest-ServerDiskConfigTestJSON-1883021162-project-member] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 1053.141587] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGHEST for action security_group_members [ 1053.141986] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.143952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.143952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.143952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.143952] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.143952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.143952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.143952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.143952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.143952] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.262045] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1053.262300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.262586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.262793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.263071] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.263222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.263300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.263536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.263606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.263768] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.265507] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.265628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.265694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.265871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.265965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.266180] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.266281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.266339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.266534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.266610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.266664] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 is going to be updated. [ 1053.311838] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.311838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.311838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.312189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.312189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.322489] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 in Status: IN_PROGRESS for 2s [ 1053.467092] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.556580] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 845b53d6-5efd-417e-be55-cf8d579b97a7: rpc.has_security_group_logging(os_id): False [ 1053.575673] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.575860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.575911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.576127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.576231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.576601] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.576773] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.576882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.577202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.577331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.577588] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 is going to be created. [ 1053.585929] env[66854]: INFO networking_nsxv3.common.synchronization [req-c489cf64-574d-4c42-95af-d3f549eab3ec req-f1dbd567-ebf1-49dc-9797-b099c202a2d1 tempest-ServerDiagnosticsNegativeTest-989293408 tempest-ServerDiagnosticsNegativeTest-989293408-project-member] Enqueued Resource ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 with Priority: HIGHEST for action security_group_members [ 1053.586487] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 with Priority: HIGHEST for action security_group_members [ 1053.587489] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-1308feff-f29c-49ab-ba49-67f2be7bd392 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.587489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.587489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.587489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.587489] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.587489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.587489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.587805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.587805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.587805] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1308feff-f29c-49ab-ba49-67f2be7bd392',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.638378] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.638642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.638642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.638878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.639078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.646458] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.646610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.646682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.647010] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.647089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.647261] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.647363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.647473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.647576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.647654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.647742] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be updated. [ 1053.653105] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 in Status: IN_PROGRESS for 2s [ 1053.675729] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.675956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.676070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.676309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.676479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.685176] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: IN_PROGRESS for 2s [ 1053.767042] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.969136] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1053.969414] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1054.090670] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.090670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.090670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.091063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.091063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.092027] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.092027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.092027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.092027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.092027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.092027] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 is going to be updated. [ 1054.129213] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.129452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.129521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.129744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.129885] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.142754] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 in Status: IN_PROGRESS for 2s [ 1054.268409] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.771892] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.772489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.775017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.775017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.775017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.775017] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1054.808135] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.808980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.808980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.808980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.808980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.818979] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1055.001053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.001624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.001624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.001624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.016402] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1055.017599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.017690] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1055.022168] env[66854]: INFO networking_nsxv3.common.synchronization [req-1f6f2bee-515e-476b-9e1c-bb4dc4388765 req-1c38c6e6-0b55-4657-9dd2-2e2eba144dbf tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1055.022168] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1055.022168] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.022168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.022168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.022168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.022168] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.022574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.022574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.022574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.022574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.022691] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.046988] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: SUCCESS [ 1055.047263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.079721] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.079721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.079721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.079721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.089557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.090521] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1055.090647] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1055.090770] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1055.139499] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.139730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.139730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.139912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.141231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.141412] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1055.221497] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.221641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.221768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.221952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.222280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.222576] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1055.329706] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.329908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.329908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.330909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.330909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.330909] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1055.331111] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'00e0f7e9-6f3b-4bea-945c-76f1da468a99', 'b0fd45c4-bc5d-47a2-a08d-dfba578f269e', '87b57f10-d9c1-422b-ae4f-428ffd202f74', '522304fc-ecb3-47d1-844c-54013760964c', 'ff920ada-bbb9-444b-aa0c-7044b7d9d450', 'cc128a33-d808-470d-8d77-03637a1be1ce', '650f976c-9aad-49d6-90f2-cd04bf828754', '44b9fe7e-d139-4b46-925d-7947b4b3dac9', 'da272d22-fe1c-4363-b694-0fd0d1bea6e5', '6a25ac3d-b904-4054-a34f-271c7b608728', '789c0fa6-0949-4f7b-a35b-21a28f7a5386', '0802f3f8-30a8-41ac-b683-cb6cd9b2602e', '8c19902d-3838-4141-b1c1-8a0050b66720', 'aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd', 'ed2d10cc-b324-427e-8dd3-5c42afadf27c', '6779288d-3538-4416-9c3b-5f739846d8f3', 'd7c2a68c-9d14-4fc3-b48e-002677e41a31', '058c84b2-3881-420f-8626-4994a562540b', '093ca7de-ad54-41b2-b5ea-68254c34b27c', '480a784d-e1e2-4919-8cb1-9c77138c1be4', '82708b01-13e8-453a-8492-93929a99b850', '1466949f-e84c-4398-88b8-456cc5ec401b', 'f8bfd71e-0706-4e38-94f5-8c8814c273e6', '004af225-cfe6-418e-bf9b-b21fc4fcd911', '7025fd1c-e490-40e6-9db4-8ead9e399bb5', 'a491a51f-1883-4e2c-a822-89d817e590ca', '1308feff-f29c-49ab-ba49-67f2be7bd392', '141d1a4a-af29-49fe-8321-94ad97de005a', '26ccc5a4-8c8a-445b-b37a-462c691c3639', 'ee66d96e-b19b-40e4-b459-52eebc42250e', '2102370c-50ee-4712-bad2-1dc6ac49ebb5', 'b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3', '845b53d6-5efd-417e-be55-cf8d579b97a7', '97e4bb3e-c69c-45a4-812a-564327f5ba24', 'bd8df7a7-7bdc-4ef6-8502-08f458c1982a', '9780d851-7ce4-4e40-ae84-ac55f3124f1e', 'db9d8667-c0a3-4930-8f4b-8672f1d358e9', '28e22ce0-3477-434c-a48d-67bbaaa395f5', '404f4fa4-39e5-44f2-b930-0c5f5853142c', 'f972a36b-9b6b-4a54-abd1-328458bb94ea', '6ab5dfec-4c69-486f-983d-2ea9413eccfa', '4147e97c-db2e-4b4d-a03e-ee42eaaab8e0', 'e609d95d-5be9-41f5-b37f-2462907e2f6a', '71d1134e-4384-4c31-836b-3726375f2c2c', 'a12683d9-3f0c-4d0e-adac-f42cb41ab395', '5b4083ca-5955-4d5e-bfa3-13977c48a75e'} {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1055.331111] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1055.333038] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 in Status: SUCCESS [ 1055.333038] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 deletion is rescheduled due to dependency. [ 1055.333038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.374167] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.374402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.374402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.374691] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.374819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.374974] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1055.375070] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1055.375186] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1055.456362] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.456542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.456703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.456824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.457824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.458167] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1055.458268] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1055.458339] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1055.458407] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1055.458488] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1055.458563] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGH for action security_group_rules [ 1055.458646] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGH for action security_group_rules [ 1055.458713] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGH for action security_group_rules [ 1055.458777] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGH for action security_group_rules [ 1055.458840] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 with Priority: HIGH for action security_group_rules [ 1055.458903] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGH for action security_group_rules [ 1055.458967] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGH for action security_group_rules [ 1055.459040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGH for action security_group_rules [ 1055.459106] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGH for action security_group_rules [ 1055.459170] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGH for action security_group_rules [ 1055.459234] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGH for action security_group_rules [ 1055.459296] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e with Priority: HIGH for action security_group_rules [ 1055.459357] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGH for action security_group_rules [ 1055.459419] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGH for action security_group_rules [ 1055.459502] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c with Priority: HIGH for action security_group_rules [ 1055.459572] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGH for action security_group_rules [ 1055.459637] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGH for action security_group_rules [ 1055.459702] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGH for action security_group_rules [ 1055.459765] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c with Priority: HIGH for action security_group_rules [ 1055.459829] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 with Priority: HIGH for action security_group_rules [ 1055.459926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.525733] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.525733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.525733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.526184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.565829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.566136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.566265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.566334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.566534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.566621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.566715] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1055.632640] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.632793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.632865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.633082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.633227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.655194] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1055.687550] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 in Status: SUCCESS [ 1055.687827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.706183] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 in Status: SUCCESS [ 1055.706416] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 deletion is rescheduled due to dependency. [ 1055.706711] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.156641] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 in Status: SUCCESS [ 1056.156641] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 deletion is rescheduled due to dependency. [ 1056.156641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.831792] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1056.831792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.831792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.831950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.832076] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.832202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.832272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.832630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.832630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.832630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.832807] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.337124] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.338344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.338521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.338865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.339176] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.339380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.339540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.339823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.339990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.340179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.340465] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.340672] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.340838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.341121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.341389] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.341570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.341706] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.341974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.343973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.343973] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.343973] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.665694] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1057.665864] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 1057.665982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.846441] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44b9fe7e-d139-4b46-925d-7947b4b3dac9: rpc.has_security_group_logging(os_id): False [ 1057.867678] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.867678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.867678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.867922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.890562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.890679] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.891245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.891245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.891245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.891403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.891595] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.892411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.892411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.892411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.892411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.892411] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.892411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.892411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.892728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.892728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.892820] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1057.970990] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.971191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.971341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.971500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.971628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.995307] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1060.015480] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1060.015909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.022617] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1060.022821] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1060.022865] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 with Priority: HIGH for action security_group_rules [ 1060.023342] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 with Priority: HIGH for action security_group_rules [ 1060.023524] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGH for action security_group_rules [ 1060.023636] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c with Priority: HIGH for action security_group_rules [ 1060.023739] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 with Priority: HIGH for action security_group_rules [ 1060.023840] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c with Priority: HIGH for action security_group_rules [ 1060.023937] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c84b2-3881-420f-8626-4994a562540b with Priority: HIGH for action security_group_rules [ 1060.024044] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 with Priority: HIGH for action security_group_rules [ 1060.024149] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd with Priority: HIGH for action security_group_rules [ 1060.024250] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGH for action security_group_rules [ 1060.024341] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGH for action security_group_rules [ 1060.024434] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e with Priority: HIGH for action security_group_rules [ 1060.024525] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGH for action security_group_rules [ 1060.024613] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGH for action security_group_rules [ 1060.024702] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 with Priority: HIGH for action security_group_rules [ 1060.024793] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc128a33-d808-470d-8d77-03637a1be1ce with Priority: HIGH for action security_group_rules [ 1060.024881] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGH for action security_group_rules [ 1060.024974] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 with Priority: HIGH for action security_group_rules [ 1060.025080] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e with Priority: HIGH for action security_group_rules [ 1060.025174] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522304fc-ecb3-47d1-844c-54013760964c with Priority: HIGH for action security_group_rules [ 1060.025544] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.025686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.025756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.025974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.026496] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e0f7e9-6f3b-4bea-945c-76f1da468a99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.028349] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87b57f10-d9c1-422b-ae4f-428ffd202f74 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.028523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.028609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.028805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.028889] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87b57f10-d9c1-422b-ae4f-428ffd202f74',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.030121] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.030264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.030552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.030907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.030907] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.032699] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2d10cc-b324-427e-8dd3-5c42afadf27c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.032869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.032929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.033180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.033263] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2d10cc-b324-427e-8dd3-5c42afadf27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.034163] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-480a784d-e1e2-4919-8cb1-9c77138c1be4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.034336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.034453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.034710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.034785] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('480a784d-e1e2-4919-8cb1-9c77138c1be4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.035744] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-093ca7de-ad54-41b2-b5ea-68254c34b27c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.035894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.035964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.036177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.036277] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('093ca7de-ad54-41b2-b5ea-68254c34b27c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.037299] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-058c84b2-3881-420f-8626-4994a562540b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.037476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.037582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.037826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.037924] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('058c84b2-3881-420f-8626-4994a562540b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.038663] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.038805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.038894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.039096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.039196] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7c2a68c-9d14-4fc3-b48e-002677e41a31',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.040118] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.040269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.040336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.040482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.040556] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.041356] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.042025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.042025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.042438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.042438] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.043165] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c19902d-3838-4141-b1c1-8a0050b66720 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.043309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.043354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.043520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.043620] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.046810] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0802f3f8-30a8-41ac-b683-cb6cd9b2602e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.047526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.047526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.047831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.048546] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0802f3f8-30a8-41ac-b683-cb6cd9b2602e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.049281] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.050846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.050846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.050846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.050846] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.051330] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.051488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.051577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.051828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.051931] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.053521] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.053673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.053763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.054425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.054557] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da272d22-fe1c-4363-b694-0fd0d1bea6e5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.055360] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc128a33-d808-470d-8d77-03637a1be1ce taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.055719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.055823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.056023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.056145] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc128a33-d808-470d-8d77-03637a1be1ce',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.057320] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.057472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.057564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.057742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.057825] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.059521] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff920ada-bbb9-444b-aa0c-7044b7d9d450 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.059696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.059789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.060031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.060125] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff920ada-bbb9-444b-aa0c-7044b7d9d450',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.061399] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.061514] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.061573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.061732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.061809] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0fd45c4-bc5d-47a2-a08d-dfba578f269e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.062653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-522304fc-ecb3-47d1-844c-54013760964c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.062894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.062992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.063212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.064448] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('522304fc-ecb3-47d1-844c-54013760964c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.095065] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.095276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.095343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.097458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.097880] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.097880] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.117190] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.117334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.119456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.121143] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e0f7e9-6f3b-4bea-945c-76f1da468a99 is going to be deleted. [ 1060.121532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.121793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.151183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.151359] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 480a784d-e1e2-4919-8cb1-9c77138c1be4 is going to be deleted. [ 1060.153466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.153710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.175607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.177023] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87b57f10-d9c1-422b-ae4f-428ffd202f74 is going to be deleted. [ 1060.191053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.191553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.191553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.191691] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.191735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.191841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e0f7e9-6f3b-4bea-945c-76f1da468a99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.209733] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.209733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.209733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.209733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.209733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.209733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-480a784d-e1e2-4919-8cb1-9c77138c1be4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.238150] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.238338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.238418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.238651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.238745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.238866] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87b57f10-d9c1-422b-ae4f-428ffd202f74" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.418172] env[66854]: INFO networking_nsxv3.common.synchronization [None req-47a0b235-c61e-4b54-802b-f1008ece73a4 None None] Enqueued Resource ID: 768d3fc9-0a2c-4bf8-8a45-f92a912cfbbb with Priority: HIGHEST for action port [ 1060.418781] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 768d3fc9-0a2c-4bf8-8a45-f92a912cfbbb with Priority: HIGHEST for action port [ 1060.419175] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-768d3fc9-0a2c-4bf8-8a45-f92a912cfbbb taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.419505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-768d3fc9-0a2c-4bf8-8a45-f92a912cfbbb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.419505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-768d3fc9-0a2c-4bf8-8a45-f92a912cfbbb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.419645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-768d3fc9-0a2c-4bf8-8a45-f92a912cfbbb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.419735] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('768d3fc9-0a2c-4bf8-8a45-f92a912cfbbb',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.565671] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.565952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.565952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.566142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.566314] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.566417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.566482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.566630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.566736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.566827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.566919] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.570462] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.570462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.570462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.570709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.570709] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.570805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.571037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.571109] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.571144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.571234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.571320] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.580282] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.580473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.580523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.581742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.581742] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.581742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.581742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.581742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.581742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.581742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.581742] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.582453] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-789c0fa6-0949-4f7b-a35b-21a28f7a5386 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.582596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.582662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.582864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.583033] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.583128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.583843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.583843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.583843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.583843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.583843] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.584410] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c19902d-3838-4141-b1c1-8a0050b66720 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.584510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.584576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.584723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.584862] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.584985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.585086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.585277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.585382] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.585464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.586232] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.617205] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.617372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.617536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.617686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.623922] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.624515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.639469] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.639663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.642245] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.642245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.642245] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.642245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.642753] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.642871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.644718] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.644828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.645614] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.645705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.646432] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.646535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.649713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.649839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.656073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.656216] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2d10cc-b324-427e-8dd3-5c42afadf27c is going to be deleted. [ 1060.657932] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.658053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.662114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.662114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.662114] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.662114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.694346] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1060.694346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.694346] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0802f3f8-30a8-41ac-b683-cb6cd9b2602e is going to be deleted. [ 1060.695350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.695350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.736308] env[66854]: INFO networking_nsxv3.common.synchronization [None req-37cb81ec-db02-4200-a643-c37b236eaf76 tempest-ServersTestManualDisk-937553888 tempest-ServersTestManualDisk-937553888-project-member] Enqueued Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_rules [ 1060.737214] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_rules [ 1060.737292] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76446c38-ff50-4477-b278-800d793d9a4e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.737419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.737480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.738090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.738090] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.745130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.745273] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 058c84b2-3881-420f-8626-4994a562540b is going to be deleted. [ 1060.746844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.747035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.756501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.756626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.775069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.775362] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff920ada-bbb9-444b-aa0c-7044b7d9d450 is going to be deleted. [ 1060.777133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.777350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.787979] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.787979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.817787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.817787] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 522304fc-ecb3-47d1-844c-54013760964c is going to be deleted. [ 1060.818860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.818860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.852919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.852919] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da272d22-fe1c-4363-b694-0fd0d1bea6e5 is going to be deleted. [ 1060.852919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.852919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.860458] env[66854]: INFO networking_nsxv3.common.synchronization [None req-b53208fa-386d-4a56-b767-f2d5f8bab308 tempest-ServersTestManualDisk-937553888 tempest-ServersTestManualDisk-937553888-project-member] Enqueued Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_rules [ 1060.861379] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_rules [ 1060.861864] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76446c38-ff50-4477-b278-800d793d9a4e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.862164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.918414] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.918584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.920374] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.920567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.922061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.922190] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7c2a68c-9d14-4fc3-b48e-002677e41a31 is going to be deleted. [ 1060.923395] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 768d3fc9-0a2c-4bf8-8a45-f92a912cfbbb [ 1060.923642] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.923783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.923783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.924010] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.924122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.924235] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:768d3fc9-0a2c-4bf8-8a45-f92a912cfbbb already deleted. [ 1060.924382] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-768d3fc9-0a2c-4bf8-8a45-f92a912cfbbb" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.924508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.924750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.953840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.954014] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be deleted. [ 1060.955042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.955274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.966951] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.967188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.988676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.989163] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc128a33-d808-470d-8d77-03637a1be1ce is going to be deleted. [ 1060.990518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.991246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.055025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.055450] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd is going to be deleted. [ 1061.056514] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.056514] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.069808] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.070617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.070718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.071574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.071574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.071574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.071574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.071960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.071960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.071960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.072129] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.072178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.072211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.072414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.072598] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.072709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.072812] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.073155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.073324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.073690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.073932] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.079910] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.079910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.080207] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.091280] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.096964] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.098711] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.098887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.098887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.099169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.100070] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.100070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.100070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.100070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.100070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.100070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.100361] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.100361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.100361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.100461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.100702] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.101169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.101169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.101169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.101169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.101332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.101364] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.110563] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.110826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.119218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.119539] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0fd45c4-bc5d-47a2-a08d-dfba578f269e is going to be deleted. [ 1061.120405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.121089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.179826] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.179984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.211340] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.211340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.211966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.212441] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 093ca7de-ad54-41b2-b5ea-68254c34b27c is going to be deleted. [ 1061.215262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.215552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.215651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.215786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2d10cc-b324-427e-8dd3-5c42afadf27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.220704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.222129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.222129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.222129] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0802f3f8-30a8-41ac-b683-cb6cd9b2602e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.224915] env[66854]: INFO networking_nsxv3.common.synchronization [req-83ed9c23-83e0-4a2d-887f-488e0108d2a8 req-4cfda9c8-e9e5-4399-b8a6-dbbdbf0ba84f tempest-ServerActionsTestOtherB-456566424 tempest-ServerActionsTestOtherB-456566424-project-member] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1061.227851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.228171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.230294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.230294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff920ada-bbb9-444b-aa0c-7044b7d9d450" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.230294] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1061.230294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.230294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.230294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.230294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-058c84b2-3881-420f-8626-4994a562540b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.230294] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.232215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.232215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.232215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.232215] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.232215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.232215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.232215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.232215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.232215] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.234191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.234191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.234191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.235028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-522304fc-ecb3-47d1-844c-54013760964c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.235452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.235745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.235926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.235981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da272d22-fe1c-4363-b694-0fd0d1bea6e5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.236133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.236765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.236765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.236765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7c2a68c-9d14-4fc3-b48e-002677e41a31" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.236934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.237834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.237834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.237834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.237834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.237834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.237834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.238562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc128a33-d808-470d-8d77-03637a1be1ce" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.260623] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.260623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.260914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.260978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.261113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.261325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aecf83d9-c7d1-4958-9dbf-dd4ee6e9c9dd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.325874] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.326069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.326115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.326412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.326498] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.326602] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76446c38-ff50-4477-b278-800d793d9a4e already deleted. [ 1061.326676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.326816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.327118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.327118] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.346967] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.347265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.347340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.347548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.347701] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.347862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0fd45c4-bc5d-47a2-a08d-dfba578f269e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.404055] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1061.404714] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.404964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.404964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.405181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.405322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.405506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-093ca7de-ad54-41b2-b5ea-68254c34b27c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.577643] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44b9fe7e-d139-4b46-925d-7947b4b3dac9: rpc.has_security_group_logging(os_id): False [ 1061.585458] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f976c-9aad-49d6-90f2-cd04bf828754: rpc.has_security_group_logging(os_id): False [ 1061.600584] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 789c0fa6-0949-4f7b-a35b-21a28f7a5386: rpc.has_security_group_logging(os_id): False [ 1061.601993] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c19902d-3838-4141-b1c1-8a0050b66720: rpc.has_security_group_logging(os_id): False [ 1061.603215] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6779288d-3538-4416-9c3b-5f739846d8f3: rpc.has_security_group_logging(os_id): False [ 1061.612394] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.612603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.612667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.613025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.613025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.613164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.613291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.613360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.613832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.613832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.613832] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.613974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.613974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.614105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.614185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.614392] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.614556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.614672] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.614856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.614965] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.615053] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1061.617367] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.617367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.617367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.617756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.627627] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.627835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.630674] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.630868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.631647] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.631757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.638709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.639238] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.639238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.639238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.639585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.639875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.640036] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1061.641230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.641544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.668745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.668745] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.668745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.668745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.668745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.668745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.668745] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.668745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.668745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.668745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.668745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.669261] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.669261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.669261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.669261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.669261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.669437] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1061.670906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.671125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.695601] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.695810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.699120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.699472] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.699657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.699749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.700031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.700161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.700213] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 is going to be updated. [ 1061.709393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.709393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.730558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.730558] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.730558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.730948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.730948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.731077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.731239] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c19902d-3838-4141-b1c1-8a0050b66720 is going to be updated. [ 1061.732887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.733190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.733381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.736409] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.736579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.737087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.737087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.737264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.739228] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.739373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.739420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.739607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.739694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.739981] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.740224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.740224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.740344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.740457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.740497] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1061.776748] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1061.805111] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1061.809124] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.809465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.809465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.809724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.810102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.816270] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.816742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.816927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.817275] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.819018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.826795] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.827497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.827781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.828398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.831716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.842373] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1061.864451] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 in Status: IN_PROGRESS for 2s [ 1061.871068] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1061.881171] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.881475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.881475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.881951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.881951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.881951] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76446c38-ff50-4477-b278-800d793d9a4e already deleted. [ 1061.881951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.918243] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.918243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.918243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.918243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.918243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.970929] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c19902d-3838-4141-b1c1-8a0050b66720 in Status: IN_PROGRESS for 2s [ 1063.548676] env[66854]: INFO networking_nsxv3.common.synchronization [None req-19591c60-163b-4ec5-b527-d970aad056ce None None] Enqueued Resource ID: 84abca0c-cd35-4fe8-a186-ec6854d87995 with Priority: HIGHEST for action port [ 1063.549908] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84abca0c-cd35-4fe8-a186-ec6854d87995 with Priority: HIGHEST for action port [ 1063.551317] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-84abca0c-cd35-4fe8-a186-ec6854d87995 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.551439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84abca0c-cd35-4fe8-a186-ec6854d87995" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.551738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84abca0c-cd35-4fe8-a186-ec6854d87995" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.552234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84abca0c-cd35-4fe8-a186-ec6854d87995" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.552354] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84abca0c-cd35-4fe8-a186-ec6854d87995',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.791313] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1063.792569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.825822] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1063.825822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.854204] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1063.854431] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 deletion is rescheduled due to dependency. [ 1063.854491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.881087] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 in Status: SUCCESS [ 1063.881398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.884620] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1063.884838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.987823] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c19902d-3838-4141-b1c1-8a0050b66720 in Status: SUCCESS [ 1063.988648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.055441] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84abca0c-cd35-4fe8-a186-ec6854d87995 [ 1064.055760] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.055966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.056077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.056350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.056469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.056589] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84abca0c-cd35-4fe8-a186-ec6854d87995 already deleted. [ 1064.056693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84abca0c-cd35-4fe8-a186-ec6854d87995" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.793638] env[66854]: INFO networking_nsxv3.common.synchronization [req-5309d6a1-2749-4b79-97f8-b460812ad1d3 req-a441b6e2-b3dc-4db7-acaa-9634ae74e50e tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1066.794044] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1066.794356] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.794483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.794542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.794744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.794900] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.794995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.797208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.797413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.797529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.797635] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.198344] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.198567] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.198691] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.198965] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.199708] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.199883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.200014] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.200249] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.200903] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.200903] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.200903] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.200903] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.201203] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.201203] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.201203] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.201382] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.225342] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.225342] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1067.225342] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.225342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.225342] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-4ac390e1-917c-4fdd-a72c-aeb91b3e2f99 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.225342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-4ac390e1-917c-4fdd-a72c-aeb91b3e2f99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.225342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-4ac390e1-917c-4fdd-a72c-aeb91b3e2f99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.225342] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-4ac390e1-917c-4fdd-a72c-aeb91b3e2f99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.225342] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ac390e1-917c-4fdd-a72c-aeb91b3e2f99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.299636] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.299948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.300086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.300328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.300493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.300741] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.300873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.301033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.301160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.301246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.301354] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1067.331798] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.332065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.332065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.332301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.332446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.345296] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1067.728886] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.728886] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.728886] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.728886] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.728886] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.728886] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 4ac390e1-917c-4fdd-a72c-aeb91b3e2f99 not found, creating... [ 1067.729184] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.729184] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.729275] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.729617] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.729756] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.730065] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.730229] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.730354] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.730558] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.730691] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.730829] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 4ac390e1-917c-4fdd-a72c-aeb91b3e2f99 is going to be created. [ 1067.752566] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.752797] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.752921] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.753217] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.753486] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.753725] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-4ac390e1-917c-4fdd-a72c-aeb91b3e2f99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.524938] env[66854]: INFO networking_nsxv3.common.synchronization [req-5309d6a1-2749-4b79-97f8-b460812ad1d3 req-987e5eda-2f48-4b23-a527-c0a70ed2e2b0 service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 1068.524938] env[66854]: INFO networking_nsxv3.common.synchronization [req-5309d6a1-2749-4b79-97f8-b460812ad1d3 req-987e5eda-2f48-4b23-a527-c0a70ed2e2b0 service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1068.524938] env[66854]: INFO networking_nsxv3.common.synchronization [req-5309d6a1-2749-4b79-97f8-b460812ad1d3 req-987e5eda-2f48-4b23-a527-c0a70ed2e2b0 service nova] Enqueued Resource ID: 4ac390e1-917c-4fdd-a72c-aeb91b3e2f99 with Priority: HIGHEST for action port [ 1068.524938] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 1068.525473] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1068.525473] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ac390e1-917c-4fdd-a72c-aeb91b3e2f99 with Priority: HIGHEST for action port [ 1068.525656] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.525656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.525819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.527673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.527814] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.533020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.533020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.533020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ac390e1-917c-4fdd-a72c-aeb91b3e2f99 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.533020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ac390e1-917c-4fdd-a72c-aeb91b3e2f99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.533020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ac390e1-917c-4fdd-a72c-aeb91b3e2f99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.533020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ac390e1-917c-4fdd-a72c-aeb91b3e2f99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.533020] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ac390e1-917c-4fdd-a72c-aeb91b3e2f99',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.578461] env[66854]: INFO networking_nsxv3.common.synchronization [None req-2eb3165d-a843-4f46-94d9-54b705255a81 None None] Enqueued Resource ID: 144e4979-877c-4828-bc30-36a813a13c8b with Priority: HIGHEST for action port [ 1068.578967] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 144e4979-877c-4828-bc30-36a813a13c8b with Priority: HIGHEST for action port [ 1068.579379] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-144e4979-877c-4828-bc30-36a813a13c8b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.579803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-144e4979-877c-4828-bc30-36a813a13c8b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.579803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-144e4979-877c-4828-bc30-36a813a13c8b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.579939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-144e4979-877c-4828-bc30-36a813a13c8b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.579939] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('144e4979-877c-4828-bc30-36a813a13c8b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.035234] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.035476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.035677] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ac390e1-917c-4fdd-a72c-aeb91b3e2f99 with status ACTIVE [ 1069.035838] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.035947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.036033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.036258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.036362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.036555] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.036657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.036728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.036930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.037027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.037237] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.037348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.037413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.037569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.037644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.037729] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ac390e1-917c-4fdd-a72c-aeb91b3e2f99 is going to be updated. [ 1069.061802] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.061802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.062023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.065063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.065063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.065063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ac390e1-917c-4fdd-a72c-aeb91b3e2f99" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.082125] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 144e4979-877c-4828-bc30-36a813a13c8b [ 1069.082388] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.082529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.082602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.083246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.083246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.083246] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:144e4979-877c-4828-bc30-36a813a13c8b already deleted. [ 1069.083246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-144e4979-877c-4828-bc30-36a813a13c8b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.235603] env[66854]: INFO networking_nsxv3.common.synchronization [req-33dfb5e4-793e-4ae7-a375-0531a4962fed req-c59a404d-2b21-424a-b3cd-49f5b5c0c292 tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1069.236696] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1069.236696] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.236696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.236930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.236930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.237456] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.237785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.237785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.237889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.237889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.238019] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.357370] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1069.357777] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 1069.357777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.357974] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.358108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.358266] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.358477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.358477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.358606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.358665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.358760] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.468955] env[66854]: INFO networking_nsxv3.common.synchronization [None req-c430cc48-0d1d-4e6d-846a-ee6350f923a8 tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_rules [ 1069.469527] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_rules [ 1069.469853] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.469986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.470064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.470708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.470708] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.590285] env[66854]: INFO networking_nsxv3.common.synchronization [None req-2935a5ed-8240-46a0-a487-4de74524e907 tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_rules [ 1069.590939] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_rules [ 1069.591435] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.591518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.691824] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-541 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.691824] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.691824] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.691824] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.691824] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.691824] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.693029] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.693029] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.693766] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.693766] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.693766] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.693766] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.693945] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.693945] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.694052] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.694198] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.714537] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.715567] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1069.715567] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.715567] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.715567] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-c5a63679-457c-4f7f-b110-5410fcd6c934 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.715567] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-c5a63679-457c-4f7f-b110-5410fcd6c934" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.715865] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-c5a63679-457c-4f7f-b110-5410fcd6c934" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.715929] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-c5a63679-457c-4f7f-b110-5410fcd6c934" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.716076] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a63679-457c-4f7f-b110-5410fcd6c934',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.741115] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.861420] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.997032] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.997032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.997032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.997032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.997376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.997545] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 already deleted. [ 1069.997700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.997933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.998199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.998372] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.221273] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.221499] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.221694] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.221889] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.222041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.222215] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port c5a63679-457c-4f7f-b110-5410fcd6c934 not found, creating... [ 1070.222670] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.222828] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.222941] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.223188] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.223318] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.223602] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.223765] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.223859] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.224863] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.225046] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.227274] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: c5a63679-457c-4f7f-b110-5410fcd6c934 is going to be created. [ 1070.244299] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.255987] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.256278] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.256414] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.256706] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.257400] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.257819] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-c5a63679-457c-4f7f-b110-5410fcd6c934" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.364579] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.521563] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.521762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.521824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.522035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.522149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.522280] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 already deleted. [ 1070.522492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.749637] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.749637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.749637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.749637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.749637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.749637] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1070.797338] env[66854]: INFO networking_nsxv3.common.synchronization [None req-a15b7ade-baf9-4048-aebd-a953d04a5f3d None None] Enqueued Resource ID: 20517195-20d2-465b-93bf-7f51008b3cbd with Priority: HIGHEST for action port [ 1070.801086] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.801256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.801340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.801645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.801979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.803889] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20517195-20d2-465b-93bf-7f51008b3cbd with Priority: HIGHEST for action port [ 1070.804642] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-20517195-20d2-465b-93bf-7f51008b3cbd taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.804642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20517195-20d2-465b-93bf-7f51008b3cbd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.804642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20517195-20d2-465b-93bf-7f51008b3cbd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.804905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20517195-20d2-465b-93bf-7f51008b3cbd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.805507] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20517195-20d2-465b-93bf-7f51008b3cbd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.815215] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1070.867876] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.867876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.867876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.868033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.868136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.868441] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1070.916259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.916575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.916575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.916825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.916825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.933204] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1071.035685] env[66854]: INFO networking_nsxv3.common.synchronization [req-33dfb5e4-793e-4ae7-a375-0531a4962fed req-4b6109c8-f4c1-4490-b693-18902aa85663 service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 1071.035875] env[66854]: INFO networking_nsxv3.common.synchronization [req-33dfb5e4-793e-4ae7-a375-0531a4962fed req-4b6109c8-f4c1-4490-b693-18902aa85663 service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1071.036023] env[66854]: INFO networking_nsxv3.common.synchronization [req-33dfb5e4-793e-4ae7-a375-0531a4962fed req-4b6109c8-f4c1-4490-b693-18902aa85663 service nova] Enqueued Resource ID: c5a63679-457c-4f7f-b110-5410fcd6c934 with Priority: HIGHEST for action port [ 1071.036532] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 1071.036664] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1071.036763] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5a63679-457c-4f7f-b110-5410fcd6c934 with Priority: HIGHEST for action port [ 1071.037102] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.037252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.037306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.037504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.037610] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.038454] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.038550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.038742] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5a63679-457c-4f7f-b110-5410fcd6c934 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.038839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5a63679-457c-4f7f-b110-5410fcd6c934" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.038900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5a63679-457c-4f7f-b110-5410fcd6c934" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.039149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5a63679-457c-4f7f-b110-5410fcd6c934" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.039232] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a63679-457c-4f7f-b110-5410fcd6c934',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.311121] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20517195-20d2-465b-93bf-7f51008b3cbd [ 1071.312978] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.312978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.312978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.312978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.312978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.312978] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20517195-20d2-465b-93bf-7f51008b3cbd already deleted. [ 1071.312978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20517195-20d2-465b-93bf-7f51008b3cbd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.540910] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.541015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.542333] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5a63679-457c-4f7f-b110-5410fcd6c934 with status ACTIVE [ 1071.543304] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.543573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.543651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.543944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.544121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.544286] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.544410] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.544492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.544672] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.544784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.544982] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.545204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.545204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.545362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.545419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.545510] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5a63679-457c-4f7f-b110-5410fcd6c934 is going to be updated. [ 1071.569325] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.569446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.569446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.569634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.569777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.570495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5a63679-457c-4f7f-b110-5410fcd6c934" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.907282] env[66854]: INFO networking_nsxv3.common.synchronization [req-c39f0acb-c735-49e3-a502-30e375b0ec8f req-5ade5028-0e4e-467c-9e82-b2a034bc0f41 tempest-ImagesTestJSON-1862869845 tempest-ImagesTestJSON-1862869845-project-member] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1071.907817] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1071.908328] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.908468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.908532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.908753] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.908947] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.909149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.909244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.909376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.909456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.909563] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.412083] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.826302] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1072.826537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.826758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.827230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.827448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.827583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.827655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.827838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.828487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.828487] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.914358] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.944186] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1072.944263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.944513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.944862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.945171] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.945410] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.945471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.945646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.945758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.945867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.945920] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.330821] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.417526] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.417789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.417918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.418269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.418471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.418591] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1073.450097] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.450263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.450330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.451026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.451026] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.451026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.451026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.451241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.451241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.451305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.451679] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.451679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.451950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.452064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.452235] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.452355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.452485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.452576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.452688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.453191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.453191] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.458210] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.458210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.458210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.458210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.458210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.467131] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1073.833619] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.958665] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab5dfec-4c69-486f-983d-2ea9413eccfa: rpc.has_security_group_logging(os_id): False [ 1073.980207] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.980374] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.980452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.980670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.980763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.980988] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.981102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.981169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.981322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.981402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.981676] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.981792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.981865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.982074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.982171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.982374] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.982500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.982567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.982716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.982795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.982887] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1074.055684] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.055839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.055912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.056241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.056298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.070911] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1074.336865] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.337187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.337256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.337484] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.337573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.337679] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1074.367987] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.368234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.368234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.368425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.368584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.379246] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1074.613358] env[66854]: INFO networking_nsxv3.common.synchronization [req-34357d26-b8d1-4849-ac5e-e9764a28fc58 req-90348c98-1032-4cbc-b6c4-53460ef37e2a tempest-ServersTestManualDisk-937553888 tempest-ServersTestManualDisk-937553888-project-member] Enqueued Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_members [ 1074.613896] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_members [ 1074.614215] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-76446c38-ff50-4477-b278-800d793d9a4e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.614374] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.614480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.614822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.616805] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.616995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.617338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.617455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.618158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.618158] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.935042] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.935362] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-230" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.935541] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-230" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.935894] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-230" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.936243] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.936408] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.936527] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.936774] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.936926] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.937162] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.937275] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.937383] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.937809] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.937809] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.937809] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.937809] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.961391] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.961391] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.961391] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.961391] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-230" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.961783] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-62ad9080-8215-430c-8de5-5a7074d38b0e taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.961868] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-62ad9080-8215-430c-8de5-5a7074d38b0e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.961953] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-62ad9080-8215-430c-8de5-5a7074d38b0e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.962295] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-62ad9080-8215-430c-8de5-5a7074d38b0e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.962432] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62ad9080-8215-430c-8de5-5a7074d38b0e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.120674] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.121363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.121363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.121363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.121363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.121706] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.122116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.122116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.122273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.122273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.122365] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76446c38-ff50-4477-b278-800d793d9a4e already deleted. [ 1075.122450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.466654] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.466974] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.467160] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.467482] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.467677] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.467843] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 62ad9080-8215-430c-8de5-5a7074d38b0e not found, creating... [ 1075.468179] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.468431] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.468588] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.468926] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.469102] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.469447] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.469665] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.469762] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.470039] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.470182] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.470345] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 62ad9080-8215-430c-8de5-5a7074d38b0e is going to be created. [ 1075.481688] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1075.481983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.493418] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.494251] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.494251] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.494251] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.494459] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.494888] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-62ad9080-8215-430c-8de5-5a7074d38b0e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.097581] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1076.101297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.261705] env[66854]: INFO networking_nsxv3.common.synchronization [req-34357d26-b8d1-4849-ac5e-e9764a28fc58 req-87b6c35f-dea1-44f9-8f49-42b6b68a70b1 service nova] Enqueued Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_rules [ 1076.261951] env[66854]: INFO networking_nsxv3.common.synchronization [req-34357d26-b8d1-4849-ac5e-e9764a28fc58 req-87b6c35f-dea1-44f9-8f49-42b6b68a70b1 service nova] Enqueued Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_members [ 1076.262143] env[66854]: INFO networking_nsxv3.common.synchronization [req-34357d26-b8d1-4849-ac5e-e9764a28fc58 req-87b6c35f-dea1-44f9-8f49-42b6b68a70b1 service nova] Enqueued Resource ID: 62ad9080-8215-430c-8de5-5a7074d38b0e with Priority: HIGHEST for action port [ 1076.262721] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_rules [ 1076.263477] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_members [ 1076.263589] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ad9080-8215-430c-8de5-5a7074d38b0e with Priority: HIGHEST for action port [ 1076.263919] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76446c38-ff50-4477-b278-800d793d9a4e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.264082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.264151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.264390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.264480] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.266093] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-76446c38-ff50-4477-b278-800d793d9a4e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.266093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.266093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.266093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.266093] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.266093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.266093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.266473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.266473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.266473] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.267176] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-62ad9080-8215-430c-8de5-5a7074d38b0e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.267278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62ad9080-8215-430c-8de5-5a7074d38b0e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.267364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62ad9080-8215-430c-8de5-5a7074d38b0e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.268037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62ad9080-8215-430c-8de5-5a7074d38b0e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.268037] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62ad9080-8215-430c-8de5-5a7074d38b0e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.390706] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1076.390994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.391278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.391523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.391933] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.392134] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.392238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.392659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.392659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.392659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.392852] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.769479] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-76446c38-ff50-4477-b278-800d793d9a4e taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.769723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.771116] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62ad9080-8215-430c-8de5-5a7074d38b0e with status ACTIVE [ 1076.771361] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.771547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.772053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.772053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.772053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.772362] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.772442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.772573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.772806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.772963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.773228] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.773469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.773469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.773684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.773966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.773966] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62ad9080-8215-430c-8de5-5a7074d38b0e is going to be updated. [ 1076.775158] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.797313] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.797541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.797541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.797739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.797879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.798092] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62ad9080-8215-430c-8de5-5a7074d38b0e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.896069] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.896069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.896069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.896069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.896390] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.896390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.896479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.896577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.896663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.896764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.896977] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.897045] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.897084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.897301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.897408] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.897520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.897584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.897740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.897826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.897910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.898028] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.997821] env[66854]: INFO networking_nsxv3.common.synchronization [req-d76d6b0e-e61b-4664-8078-7290cc09b77e req-6ad0a9f7-a63f-4292-993e-ab1e343c20aa tempest-ServerActionsTestOtherB-456566424 tempest-ServerActionsTestOtherB-456566424-project-member] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1076.998748] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1076.999454] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.999581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.999668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.999969] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.000154] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.000263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.000329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.000487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.000595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.000665] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.278199] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.371701] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-323 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.371926] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.372444] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.372444] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.373903] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.373903] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.373903] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.374171] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.374327] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.375771] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.375771] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.375771] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.375771] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.375771] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.375771] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.375771] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.399831] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.399993] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.400197] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.400355] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.400708] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-77679222-60f8-44c5-96cd-46da53caabc9 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.400904] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-77679222-60f8-44c5-96cd-46da53caabc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.401058] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-77679222-60f8-44c5-96cd-46da53caabc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.401466] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-77679222-60f8-44c5-96cd-46da53caabc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.402177] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77679222-60f8-44c5-96cd-46da53caabc9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.402597] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6779288d-3538-4416-9c3b-5f739846d8f3: rpc.has_security_group_logging(os_id): False [ 1077.421795] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.422071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.422071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.422221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.422276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.422515] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.422731] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.422811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.422966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.423058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.423248] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.423344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.423406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.423542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.423611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.423809] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.424015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.424115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.424262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.424433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.424433] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1077.453970] env[66854]: INFO networking_nsxv3.common.synchronization [req-7c485b6e-2d8c-4785-b1e5-981f9f725015 req-8a98a458-ba03-450a-bd85-86d37e7eb4b9 tempest-ServerRescueTestJSON-1131573559 tempest-ServerRescueTestJSON-1131573559-project-member] Enqueued Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1077.454516] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1077.454878] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.454997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.455049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.455394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.455477] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.455549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.455601] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.455736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.455822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.455913] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.502791] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.503186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.503186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.503387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.503433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.504668] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.504792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.504948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.505193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.505299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.505501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.505599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.505662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.506030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.506030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.506140] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1077.536970] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1077.562829] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.562981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.563059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.563273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.563415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.575222] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1077.781458] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.781669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.781720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.781929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.782037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.782153] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76446c38-ff50-4477-b278-800d793d9a4e is going to be created. [ 1077.817215] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.817564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.817564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.817714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.817866] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.830415] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76446c38-ff50-4477-b278-800d793d9a4e in Status: UNINITIALIZED for 2s [ 1077.906031] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.906031] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.906031] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.906411] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.906411] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.906658] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 77679222-60f8-44c5-96cd-46da53caabc9 not found, creating... [ 1077.906965] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.907166] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.907283] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.907678] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.907678] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.908015] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.908621] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.908621] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.908621] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.908785] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.908887] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 77679222-60f8-44c5-96cd-46da53caabc9 is going to be created. [ 1077.932658] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.933022] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.933100] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.933365] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.933604] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.933862] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-77679222-60f8-44c5-96cd-46da53caabc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.958715] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.987044] env[66854]: INFO networking_nsxv3.common.synchronization [req-a4a9c35d-07b5-449c-a22a-5c6b91351df8 req-16f360bf-15c2-42ec-ad23-f47f14a5b0b3 tempest-ServerRescueNegativeTestJSON-1659784790 tempest-ServerRescueNegativeTestJSON-1659784790-project-member] Enqueued Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_members [ 1077.987705] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGHEST for action security_group_members [ 1077.988226] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-789c0fa6-0949-4f7b-a35b-21a28f7a5386 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.988450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.988450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.988719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.988906] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.989080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.989144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.989286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.989355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.989468] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.462458] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.495677] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.495677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.495677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.495677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.495677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.495677] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.495677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.495677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.495677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.495677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.495677] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 is going to be updated. [ 1078.533272] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.533272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.533272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.533272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.533272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.549468] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 in Status: IN_PROGRESS for 2s [ 1078.804136] env[66854]: INFO networking_nsxv3.common.synchronization [req-d76d6b0e-e61b-4664-8078-7290cc09b77e req-178d68c6-9997-4dc8-89df-0fef3e25f225 service nova] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 1078.804391] env[66854]: INFO networking_nsxv3.common.synchronization [req-d76d6b0e-e61b-4664-8078-7290cc09b77e req-178d68c6-9997-4dc8-89df-0fef3e25f225 service nova] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1078.804608] env[66854]: INFO networking_nsxv3.common.synchronization [req-d76d6b0e-e61b-4664-8078-7290cc09b77e req-178d68c6-9997-4dc8-89df-0fef3e25f225 service nova] Enqueued Resource ID: 77679222-60f8-44c5-96cd-46da53caabc9 with Priority: HIGHEST for action port [ 1078.805258] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 1078.805517] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1078.805570] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77679222-60f8-44c5-96cd-46da53caabc9 with Priority: HIGHEST for action port [ 1078.806028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.806178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.806280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.806582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.806678] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.807562] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.807682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.807875] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-77679222-60f8-44c5-96cd-46da53caabc9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.808017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77679222-60f8-44c5-96cd-46da53caabc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.808017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77679222-60f8-44c5-96cd-46da53caabc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.808492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77679222-60f8-44c5-96cd-46da53caabc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.808492] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77679222-60f8-44c5-96cd-46da53caabc9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.968192] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.968445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.968552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.968779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.968875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.968980] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee66d96e-b19b-40e4-b459-52eebc42250e is going to be updated. [ 1079.003874] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.003874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.003874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.003874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.003874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.015575] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: IN_PROGRESS for 2s [ 1079.310478] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.310478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.310478] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77679222-60f8-44c5-96cd-46da53caabc9 with status ACTIVE [ 1079.310478] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.310478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.310478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.310478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.310478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.310478] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.310478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.310478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.310478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.310478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.310478] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.316055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.316055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.316055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.316055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.316055] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77679222-60f8-44c5-96cd-46da53caabc9 is going to be updated. [ 1079.355753] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.356245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.356540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.356822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.357213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.357848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77679222-60f8-44c5-96cd-46da53caabc9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.554454] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1079.554454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.584423] env[66854]: INFO networking_nsxv3.common.synchronization [req-29130f43-d621-4019-8521-9e35f1a60908 req-4a982c33-55e1-4ad0-9d3c-40a48f07f81e tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1079.585143] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1079.585437] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.585565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.585708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.586163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.586163] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.586316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.586316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.586481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.586582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.586705] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.588195] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1079.588360] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 deletion is rescheduled due to dependency. [ 1079.588491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.588934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.589133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.589302] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.589439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.589510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.589686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.589785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.589887] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.840598] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76446c38-ff50-4477-b278-800d793d9a4e in Status: SUCCESS [ 1079.840873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.841114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.841337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.841527] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.841644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.841726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.841891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.841972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.842070] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.842239] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.936897] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.937149] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.937273] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.937598] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.937859] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.940912] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.941408] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.941799] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.941969] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.942223] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.942352] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.942791] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.942791] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.942791] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.942791] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.942954] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.961450] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.961934] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1079.962205] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.962286] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.962772] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-6dc614d8-9de0-4d79-b69b-bcda320e74be taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.962772] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-6dc614d8-9de0-4d79-b69b-bcda320e74be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.962941] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-6dc614d8-9de0-4d79-b69b-bcda320e74be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.963367] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-6dc614d8-9de0-4d79-b69b-bcda320e74be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.963367] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dc614d8-9de0-4d79-b69b-bcda320e74be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.091785] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.091785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.091785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.091785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.091785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.091785] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.091785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.091785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.091785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.091785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.091785] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 already deleted. [ 1080.091785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.091785] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.347346] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.466249] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.466491] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.466619] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.466911] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.467079] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.467256] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 6dc614d8-9de0-4d79-b69b-bcda320e74be not found, creating... [ 1080.467543] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.467758] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.467918] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.468172] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.468371] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.468784] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.468860] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.468961] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.469209] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.469403] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.469576] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 6dc614d8-9de0-4d79-b69b-bcda320e74be is going to be created. [ 1080.492556] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.492852] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.493093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.493441] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.493707] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.494047] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-6dc614d8-9de0-4d79-b69b-bcda320e74be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.559762] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 in Status: SUCCESS [ 1080.560166] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 deletion is rescheduled due to dependency. [ 1080.560166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.596840] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.849804] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76446c38-ff50-4477-b278-800d793d9a4e: rpc.has_security_group_logging(os_id): False [ 1080.879206] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.879481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.879549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.879922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.880080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.880549] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.880549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.880722] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.880846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.880960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.881084] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76446c38-ff50-4477-b278-800d793d9a4e is going to be created. [ 1080.963604] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.963786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.963860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.964120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.964236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.987698] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76446c38-ff50-4477-b278-800d793d9a4e in Status: IN_PROGRESS for 2s [ 1081.027958] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: SUCCESS [ 1081.027958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.100035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.100035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.100283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.100769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.100897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.101105] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1081.151027] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.151218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.151318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.151640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.151899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.163624] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1081.231700] env[66854]: INFO networking_nsxv3.common.synchronization [req-29130f43-d621-4019-8521-9e35f1a60908 req-c18f9545-d4a2-48d5-a49b-cd694bca5c6b service nova] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_rules [ 1081.231700] env[66854]: INFO networking_nsxv3.common.synchronization [req-29130f43-d621-4019-8521-9e35f1a60908 req-c18f9545-d4a2-48d5-a49b-cd694bca5c6b service nova] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1081.232036] env[66854]: INFO networking_nsxv3.common.synchronization [req-29130f43-d621-4019-8521-9e35f1a60908 req-c18f9545-d4a2-48d5-a49b-cd694bca5c6b service nova] Enqueued Resource ID: 6dc614d8-9de0-4d79-b69b-bcda320e74be with Priority: HIGHEST for action port [ 1081.232748] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_rules [ 1081.232962] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1081.233536] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc614d8-9de0-4d79-b69b-bcda320e74be with Priority: HIGHEST for action port [ 1081.233702] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.233821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.233972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.234795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.234795] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.236137] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.236137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.236137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.236137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.236347] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.236347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.236435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.236610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.236708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.236830] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.238581] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dc614d8-9de0-4d79-b69b-bcda320e74be taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.238581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dc614d8-9de0-4d79-b69b-bcda320e74be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.238581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dc614d8-9de0-4d79-b69b-bcda320e74be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.238810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dc614d8-9de0-4d79-b69b-bcda320e74be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.238810] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dc614d8-9de0-4d79-b69b-bcda320e74be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.740446] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.742570] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.742751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.743519] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6dc614d8-9de0-4d79-b69b-bcda320e74be with status ACTIVE [ 1081.743519] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.743519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.743519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.743908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.743908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.744015] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.744347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.744347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.744428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.744461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.744674] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.745116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.746063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.746063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.746063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.746063] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6dc614d8-9de0-4d79-b69b-bcda320e74be is going to be updated. [ 1081.767452] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.767597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.767667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.767873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.768028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.768193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dc614d8-9de0-4d79-b69b-bcda320e74be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.244227] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.746797] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.747163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.747163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.747272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.747367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.747466] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be created. [ 1082.774060] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.774060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.774320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.774362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.774496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.785184] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: UNINITIALIZED for 2s [ 1082.999475] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76446c38-ff50-4477-b278-800d793d9a4e in Status: SUCCESS [ 1082.999698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.175984] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1083.175984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.176523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.176523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.176648] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.176770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.176841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.177023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.177152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.177222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.177305] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.680665] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.826930] env[66854]: INFO networking_nsxv3.common.synchronization [req-2593e130-3cc4-44ec-8c34-c6b5b92fcd60 req-131e3d0e-5dca-49c9-a60a-7584f425400b tempest-ImagesTestJSON-1862869845 tempest-ImagesTestJSON-1862869845-project-member] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1083.827756] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1083.828680] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.829063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.829063] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.829398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.829714] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.829922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.830108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.830351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.830493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.830631] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.060170] env[66854]: INFO networking_nsxv3.common.synchronization [req-05ec2ede-3d5b-4afe-89e8-948f01953282 req-a9f306e7-d2b7-4307-83e6-75d5d276a77e tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1084.060415] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1084.060776] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.060899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.060968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.061199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.061357] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.061459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.061524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.061675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.061758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.061856] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.182829] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f976c-9aad-49d6-90f2-cd04bf828754: rpc.has_security_group_logging(os_id): False [ 1084.200627] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.200847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.200901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.201132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.201244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.201508] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.201621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.201687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.201846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.201927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.202033] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1084.289338] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.289338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.289338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.289735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.289803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.312339] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1084.334505] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.334505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.334505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.334505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.334505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.334505] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.335015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.335015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.335015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.335015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.335428] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1084.408164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.408460] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.408460] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.408697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.408865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.426324] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1084.564409] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.564626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.564626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.564838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.564935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.565176] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.565283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.565380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.565674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.565803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.565877] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1084.600681] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.600901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.600901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.601125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.601272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.614061] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1084.795657] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1084.795869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.796168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.796422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.796712] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.796712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.796851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.796926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.797017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.797151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.797265] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.299975] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.802489] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9e85364-8cd8-4a16-8f5e-17eb2478a9b7: rpc.has_security_group_logging(os_id): False [ 1085.822368] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.822608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.822608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.822765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.822853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.823107] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.823213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.823280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.823430] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.823509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.823599] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be created. [ 1085.910751] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.910959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.910959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.911315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.911515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.930043] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1086.327289] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1086.327800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.435857] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1086.435857] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 deletion is rescheduled due to dependency. [ 1086.435857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.625962] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1086.625962] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 1086.625962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.062455] env[66854]: INFO networking_nsxv3.common.synchronization [req-d6f81f24-3c3f-4ad5-a355-f42dce257902 req-f3cede8e-2cbf-40e1-b310-894381197a52 tempest-AttachVolumeTestJSON-1641278713 tempest-AttachVolumeTestJSON-1641278713-project-member] Enqueued Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_members [ 1087.062455] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGHEST for action security_group_members [ 1087.062455] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c19902d-3838-4141-b1c1-8a0050b66720 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.062455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.062455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.062455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.062455] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.062898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.063180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.063436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.063620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.063810] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.566326] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.566657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.566657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.566917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.567028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.567263] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.567372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.567435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.567639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.567759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.567907] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c19902d-3838-4141-b1c1-8a0050b66720 is going to be updated. [ 1087.601662] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.601804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.601881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.602119] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.602262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.613042] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c19902d-3838-4141-b1c1-8a0050b66720 in Status: IN_PROGRESS for 2s [ 1087.944909] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1087.945155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.738632] env[66854]: INFO networking_nsxv3.common.synchronization [req-32bcaace-254a-4729-99cf-05df8f03f44a req-958e7452-6647-40bc-b4f0-8ecbd6ca5dc5 tempest-ServerRescueTestJSON-1131573559 tempest-ServerRescueTestJSON-1131573559-project-member] Enqueued Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1088.740926] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGHEST for action security_group_members [ 1088.740926] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.740926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.741613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.741613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.741613] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.741613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.741613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.741820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.741820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.741820] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.247846] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.247846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.247846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.247846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.270024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.270024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.270024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.270024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.270024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.270024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.270024] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee66d96e-b19b-40e4-b459-52eebc42250e is going to be updated. [ 1089.303164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.303164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.303164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.303164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.303164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.310631] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: IN_PROGRESS for 2s [ 1089.623717] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c19902d-3838-4141-b1c1-8a0050b66720 in Status: SUCCESS [ 1089.623907] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c19902d-3838-4141-b1c1-8a0050b66720 deletion is rescheduled due to dependency. [ 1089.624022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.321080] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee66d96e-b19b-40e4-b459-52eebc42250e in Status: SUCCESS [ 1091.321464] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee66d96e-b19b-40e4-b459-52eebc42250e deletion is rescheduled due to dependency. [ 1091.321464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.436594] env[66854]: INFO networking_nsxv3.common.synchronization [req-8d307e0c-dfdb-4f39-a050-f12ecb8e6f48 req-b1e5637d-d608-48bc-80c4-c1aae70f01c8 tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1091.437183] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1091.437495] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.437642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.437703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.437903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.438074] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.438258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.438258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.438615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.438615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.438615] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.748396] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-541 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.748646] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.748768] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.749051] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.749305] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.749462] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.749579] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.749816] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.749974] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.750190] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.750305] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.750412] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.750520] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.750655] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.750762] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.750864] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.769316] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.769477] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1091.769617] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.769786] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.770164] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.770360] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.770483] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.770808] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.770947] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.942217] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.273478] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.273736] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.273866] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.274236] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.274399] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.274562] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365 not found, creating... [ 1092.274875] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.275112] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.275305] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.275600] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.275779] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.276148] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.276326] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.276480] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.276833] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.276929] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.277065] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365 is going to be created. [ 1092.303610] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.303972] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.304260] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.304665] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.305063] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.305375] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.445089] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.947898] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.948128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.948746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.948746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.948746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.948746] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1092.979855] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.980077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.980146] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.980363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.980509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.990895] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1093.025667] env[66854]: INFO networking_nsxv3.common.synchronization [req-8d307e0c-dfdb-4f39-a050-f12ecb8e6f48 req-1b2eb7bc-09df-4460-8ce1-33fa72a2b4ed service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 1093.025857] env[66854]: INFO networking_nsxv3.common.synchronization [req-8d307e0c-dfdb-4f39-a050-f12ecb8e6f48 req-1b2eb7bc-09df-4460-8ce1-33fa72a2b4ed service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1093.026039] env[66854]: INFO networking_nsxv3.common.synchronization [req-8d307e0c-dfdb-4f39-a050-f12ecb8e6f48 req-1b2eb7bc-09df-4460-8ce1-33fa72a2b4ed service nova] Enqueued Resource ID: 1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365 with Priority: HIGHEST for action port [ 1093.026659] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 1093.026794] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1093.026885] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365 with Priority: HIGHEST for action port [ 1093.027191] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.027321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.027483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.027628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.027710] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.028621] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.028755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.030164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.030277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.030491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.030717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.030852] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.532957] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365 with status ACTIVE [ 1093.533313] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.533403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.533403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.533633] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.533725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.533912] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.534060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.534111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.534226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.534301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.534483] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.534579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.534639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.534774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.534884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.534940] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365 is going to be updated. [ 1093.536156] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.536307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.557736] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.557830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.557921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.558184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.558259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.558448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b2bcf1c-5072-4ecc-a62f-bfa8ab0dc365" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.749181] env[66854]: INFO networking_nsxv3.common.synchronization [req-a83fcb62-efc3-4c76-b734-cedb8948b298 req-3c61c3b1-8f60-4119-b6fd-854cdb0a2c1c tempest-ImagesTestJSON-1862869845 tempest-ImagesTestJSON-1862869845-project-member] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1093.749181] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1093.749605] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.749977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.749977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.749977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.750209] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.750276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.750319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.750461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.750534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.750613] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.083288] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.083497] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.083617] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.083896] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.084161] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.084310] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.084421] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.084621] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.084756] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.084968] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.085119] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.085255] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.085389] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.085507] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.085611] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.085738] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.106696] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.106696] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1094.107566] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.107566] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-887" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.107566] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-a66f7cec-6f60-41ef-a4fa-0a995f79e564 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.107566] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-a66f7cec-6f60-41ef-a4fa-0a995f79e564" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.107841] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-a66f7cec-6f60-41ef-a4fa-0a995f79e564" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.108246] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-a66f7cec-6f60-41ef-a4fa-0a995f79e564" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.108392] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a66f7cec-6f60-41ef-a4fa-0a995f79e564',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.253087] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.253295] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.253393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.253675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.253798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.254081] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.254218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.254304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.254503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.254606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.254720] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1094.292308] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.292544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.292544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.292865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.293022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.302072] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1094.611141] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.611518] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.611518] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.611714] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.611864] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.612031] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port a66f7cec-6f60-41ef-a4fa-0a995f79e564 not found, creating... [ 1094.612301] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.612458] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.612576] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.612787] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.612922] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.613224] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.613379] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.613495] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.613758] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.613875] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.613981] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: a66f7cec-6f60-41ef-a4fa-0a995f79e564 is going to be created. [ 1094.641482] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.641755] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.641809] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.642093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.642330] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.642557] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-a66f7cec-6f60-41ef-a4fa-0a995f79e564" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.002031] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1095.002274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.002473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.002726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.002955] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.003091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.003217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.003332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.003425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.003529] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.357879] env[66854]: INFO networking_nsxv3.common.synchronization [req-a83fcb62-efc3-4c76-b734-cedb8948b298 req-7b2ef7fb-dcb1-4154-8404-7d06dd43de8b service nova] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_rules [ 1095.358088] env[66854]: INFO networking_nsxv3.common.synchronization [req-a83fcb62-efc3-4c76-b734-cedb8948b298 req-7b2ef7fb-dcb1-4154-8404-7d06dd43de8b service nova] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1095.358260] env[66854]: INFO networking_nsxv3.common.synchronization [req-a83fcb62-efc3-4c76-b734-cedb8948b298 req-7b2ef7fb-dcb1-4154-8404-7d06dd43de8b service nova] Enqueued Resource ID: a66f7cec-6f60-41ef-a4fa-0a995f79e564 with Priority: HIGHEST for action port [ 1095.358865] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_rules [ 1095.359013] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1095.359366] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f7cec-6f60-41ef-a4fa-0a995f79e564 with Priority: HIGHEST for action port [ 1095.359688] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.359832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.359912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.360148] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.360239] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.362168] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.362168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.362423] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-a66f7cec-6f60-41ef-a4fa-0a995f79e564 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.362533] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a66f7cec-6f60-41ef-a4fa-0a995f79e564" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.362598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a66f7cec-6f60-41ef-a4fa-0a995f79e564" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.362976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a66f7cec-6f60-41ef-a4fa-0a995f79e564" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.362976] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a66f7cec-6f60-41ef-a4fa-0a995f79e564',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.445773] env[66854]: INFO networking_nsxv3.common.synchronization [req-f9c83b58-0332-4462-9887-b1da59f0dbe1 req-ed4e1f9c-24aa-4fc4-a049-d5c39d9f14d0 tempest-ServerRescueNegativeTestJSON-1659784790 tempest-ServerRescueNegativeTestJSON-1659784790-project-member] Enqueued Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 1095.446323] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 1095.446637] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.446741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.446833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.447575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.447754] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.447864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.447932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.448106] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.448190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.448454] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.506739] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.862947] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.863395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.866463] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a66f7cec-6f60-41ef-a4fa-0a995f79e564 with status ACTIVE [ 1095.866737] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.866837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.866880] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.867118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.867208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.867463] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.867562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.867623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.867774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.867849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.868046] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.868142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.868206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.868348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.868429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.868517] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a66f7cec-6f60-41ef-a4fa-0a995f79e564 is going to be updated. [ 1095.895949] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.896190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.896190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.896367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.896509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.896673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a66f7cec-6f60-41ef-a4fa-0a995f79e564" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.951262] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.009556] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.312653] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1096.312788] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 deletion is rescheduled due to dependency. [ 1096.312830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.313050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.313221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.313411] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.313529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.313587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.313736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.313821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.314133] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.454040] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.512164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.512426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.512505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.512726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.512830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.512939] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1096.546825] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.547013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.547189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.547412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.547569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.559153] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1096.582187] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-643 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.582445] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.582590] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.582865] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.583148] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.583339] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.583489] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.583718] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.583862] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.584145] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.584263] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.584372] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.584481] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.584594] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.584698] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.584829] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.604156] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.604343] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1096.604582] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.604777] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-643" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.605107] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.605422] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.605546] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.605812] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.605948] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b46a84b6-1de9-49b4-a95f-0fe1f4df28e7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.816400] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.957379] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.957746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.957746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.957833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.957927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.958044] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 is going to be updated. [ 1096.988838] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.989015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.989095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.989309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.989456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.999706] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: IN_PROGRESS for 2s [ 1097.108946] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.109206] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.109335] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.109693] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.109799] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.110111] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.110270] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.110389] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.110610] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.110746] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.111309] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.111458] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.111546] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.111757] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.111889] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.112042] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 is going to be updated. [ 1097.136575] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.136863] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.136917] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.137243] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.137446] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.137723] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.318982] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.821333] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.821500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.821568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.821786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.821870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.822020] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1097.847689] env[66854]: INFO networking_nsxv3.common.synchronization [req-6413184c-e3f7-4f30-8d63-1b2bb27984bf req-ab2b1044-0cac-4aa9-af00-1a850f3b69d5 service nova] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_rules [ 1097.847877] env[66854]: INFO networking_nsxv3.common.synchronization [req-6413184c-e3f7-4f30-8d63-1b2bb27984bf req-ab2b1044-0cac-4aa9-af00-1a850f3b69d5 service nova] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 1097.848339] env[66854]: INFO networking_nsxv3.common.synchronization [req-6413184c-e3f7-4f30-8d63-1b2bb27984bf req-ab2b1044-0cac-4aa9-af00-1a850f3b69d5 service nova] Enqueued Resource ID: b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 with Priority: HIGHEST for action port [ 1097.848578] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_rules [ 1097.848717] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 1097.848817] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 with Priority: HIGHEST for action port [ 1097.849364] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.849454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.849525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.849800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.849902] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.851374] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.851374] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.851374] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.851374] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.851374] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.851591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.851591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.851658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.851729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.851844] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.852884] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.853031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.853288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.853288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.853626] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b46a84b6-1de9-49b4-a95f-0fe1f4df28e7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.854887] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.854953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.854992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.855140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.855287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.868041] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1098.355086] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.355539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.357736] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.358780] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 with status ACTIVE [ 1098.358997] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.359139] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.359208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.359434] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.359545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.359727] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.359827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.359912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.360113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.360193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.360378] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.360467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.360526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.360663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.360789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.360878] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b46a84b6-1de9-49b4-a95f-0fe1f4df28e7 is going to be updated. [ 1098.385609] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.385777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.385879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.386074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.386209] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.386369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b46a84b6-1de9-49b4-a95f-0fe1f4df28e7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.569099] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1098.569337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.569655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.569800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.569915] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.570039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.570108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.570276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.570364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.570452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.570549] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.863008] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.012224] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: SUCCESS [ 1099.012757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.073577] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.073788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.073833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.074124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.074360] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.074523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.074599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.074793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.074912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.075043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.075363] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.075510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.075602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.075789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.075988] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.076442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.076442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.076743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.076837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.076929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.077038] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.366134] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.366590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.366590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.366590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.366590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.366865] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 is going to be updated. [ 1099.398072] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.398478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.398478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.398478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.398788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.409493] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: IN_PROGRESS for 2s [ 1099.579421] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6779288d-3538-4416-9c3b-5f739846d8f3: rpc.has_security_group_logging(os_id): False [ 1099.598715] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.598972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.598972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.599180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.599713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.599713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.599713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.599713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.600236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.600236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.600236] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.600236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.600405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.600405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.600507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.600639] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.600724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.600787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.600923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.600997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.601112] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1099.668936] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.669184] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.669239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.669476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.669637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.700316] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1099.878751] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1099.878926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.879102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.879340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.879624] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.879748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.879816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.879985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.880083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.880171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.880266] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.382920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.383253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.383253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.383441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.383617] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.383713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.383777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.383927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.384029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.384117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.384266] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.384359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.384419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.384558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.384694] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.384780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.384844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.385010] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.385102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.385188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.385281] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.660546] env[66854]: INFO networking_nsxv3.common.synchronization [req-70c3076e-9e30-4e72-9d81-66cb538b08bc req-095f04aa-b45e-402b-90ba-bc7513d2220d tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1100.662903] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1100.662903] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.662903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.662903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.662903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.662903] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.662903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.662903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.662903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.662903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.662903] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.889022] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44b9fe7e-d139-4b46-925d-7947b4b3dac9: rpc.has_security_group_logging(os_id): False [ 1100.910294] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.910521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.910607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.910842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.910930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.911184] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.911317] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.911398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.911548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.911638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.911839] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.911937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.912018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.912149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.912224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.912444] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.912641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.912708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.912843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.912929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.913025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1100.983294] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.983492] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.983618] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.983889] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.984159] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.984331] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.984494] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.984736] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.984977] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.985221] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.985358] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.985491] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.985638] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.985785] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.985942] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.986178] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.017879] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.018118] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.018231] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.018381] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.018811] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-7875f018-6429-4bf8-abad-31f9352fb4f4 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.018995] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-7875f018-6429-4bf8-abad-31f9352fb4f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.019152] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-7875f018-6429-4bf8-abad-31f9352fb4f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.019486] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-7875f018-6429-4bf8-abad-31f9352fb4f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.019643] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7875f018-6429-4bf8-abad-31f9352fb4f4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.035984] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.035984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.035984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.035984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.036397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.055363] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1101.165143] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.165309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.165438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.165658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.165749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.165961] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.166093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.166150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.166302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.166448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.166508] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be deleted. [ 1101.201522] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.201707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.201707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.202456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.202456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.202456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.420076] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: SUCCESS [ 1101.420502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.420575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.420767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.421000] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.421164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.421257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.421451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.421548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.421654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.421761] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.522727] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.523083] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.523319] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.524094] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.524094] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.524713] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 7875f018-6429-4bf8-abad-31f9352fb4f4 not found, creating... [ 1101.524713] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.524966] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.525205] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.525579] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.525829] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.526328] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.526594] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.526806] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.527204] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.527449] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.527698] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 7875f018-6429-4bf8-abad-31f9352fb4f4 is going to be created. [ 1101.549698] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.550329] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.550329] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.550520] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.551068] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.551212] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-7875f018-6429-4bf8-abad-31f9352fb4f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.719020] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1101.719316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.924702] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.925047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.925165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.925462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.925658] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.925772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.925849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.926071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.926220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.926303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.926455] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.926567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.926635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.926790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.926967] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.927071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.927154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.927271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.927378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.927489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.927593] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.283717] env[66854]: INFO networking_nsxv3.common.synchronization [req-70c3076e-9e30-4e72-9d81-66cb538b08bc req-ba8be0a9-bcb3-40fe-a1a9-2f8397a24efc service nova] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_rules [ 1102.283976] env[66854]: INFO networking_nsxv3.common.synchronization [req-70c3076e-9e30-4e72-9d81-66cb538b08bc req-ba8be0a9-bcb3-40fe-a1a9-2f8397a24efc service nova] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1102.284163] env[66854]: INFO networking_nsxv3.common.synchronization [req-70c3076e-9e30-4e72-9d81-66cb538b08bc req-ba8be0a9-bcb3-40fe-a1a9-2f8397a24efc service nova] Enqueued Resource ID: 7875f018-6429-4bf8-abad-31f9352fb4f4 with Priority: HIGHEST for action port [ 1102.284898] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_rules [ 1102.284979] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1102.287674] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7875f018-6429-4bf8-abad-31f9352fb4f4 with Priority: HIGHEST for action port [ 1102.288332] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.289202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.289202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.289202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.289202] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.290529] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.290741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.290829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.291785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.291785] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.291785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.291785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.291785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.292144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.292144] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.294130] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-7875f018-6429-4bf8-abad-31f9352fb4f4 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.294130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7875f018-6429-4bf8-abad-31f9352fb4f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.294130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7875f018-6429-4bf8-abad-31f9352fb4f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.294579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7875f018-6429-4bf8-abad-31f9352fb4f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.294579] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7875f018-6429-4bf8-abad-31f9352fb4f4',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.433523] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a12683d9-3f0c-4d0e-adac-f42cb41ab395: rpc.has_security_group_logging(os_id): False [ 1102.461713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.462060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.462191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.462609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.483845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.484170] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.484350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.484350] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.484557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.484639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.485713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.485869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.485963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.488553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.488652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.488869] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.489665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.489764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.490033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.490154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.490266] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 is going to be updated. [ 1102.574894] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.574894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.575108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.575263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.575355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.580289] env[66854]: INFO networking_nsxv3.common.synchronization [req-7b0811ab-a1cf-41a6-88b5-1748c62ffe33 req-3900218f-39a2-4a39-a268-eb8c0588cb8f tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1102.580847] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1102.581203] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.581353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.581431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.581642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.582797] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.582910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.582957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.583140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.583233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.583335] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.629837] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: IN_PROGRESS for 2s [ 1102.796508] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.796637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.796843] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.797799] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7875f018-6429-4bf8-abad-31f9352fb4f4 with status ACTIVE [ 1102.797981] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.798103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.798686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.798686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.798686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.798686] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.798891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.798891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.798935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.798988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.800464] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.800464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.801208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.801412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.801805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.801925] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7875f018-6429-4bf8-abad-31f9352fb4f4 is going to be updated. [ 1102.828342] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.828467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.828467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.828657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.828819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.829027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7875f018-6429-4bf8-abad-31f9352fb4f4" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.074548] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1103.074795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.085750] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.304330] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.587769] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.806998] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.807355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.807355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.807541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.807664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.807828] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be created. [ 1103.830412] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.830727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.830727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.830889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.831026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.841378] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: UNINITIALIZED for 2s [ 1104.089790] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.089970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.090023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.090253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.090346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.090444] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1104.135341] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.135341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.135341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.135341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.135341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.146120] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1104.612018] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: SUCCESS [ 1104.612384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.858449] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1105.858724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.859104] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.859104] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.859313] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.859431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.859521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.859677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.859760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.859850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.859944] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.157754] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1106.157975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.362563] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.363268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.363268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.363268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.363268] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.363510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.363510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.364429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.364429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.364429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.364429] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.364429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.364429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.364702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.365101] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.365101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.365222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.365595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.365595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.365595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.365719] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.868435] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a25ac3d-b904-4054-a34f-271c7b608728: rpc.has_security_group_logging(os_id): False [ 1106.887623] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.887809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.887895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.888140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.888229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.888451] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.888548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.888611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.888767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.888846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.889054] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.889126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.889187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.889323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.889394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.889572] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.889662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.889724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.890053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.890053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.890053] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be created. [ 1106.955250] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.955406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.955551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.955849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.956166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.971628] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1107.192457] env[66854]: INFO networking_nsxv3.common.synchronization [None req-a83e7e8f-632b-4d75-b7df-31d419230ee3 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1107.192912] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1107.194271] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.194441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.194580] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.194797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.194964] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.195076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.195132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.195325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.195411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.195554] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.702251] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.204682] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.612955] env[66854]: INFO networking_nsxv3.common.synchronization [req-89932d52-796f-47bf-a363-1f61822e8953 req-eddb27b4-1275-499c-a61c-ec1aa9d1e849 tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1108.613522] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1108.613831] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.613953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.614872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.615244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.615325] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.615420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.615486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.615961] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.616134] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.616178] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.708146] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.708332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.709364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.709364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.709364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.709364] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1108.743111] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.743300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.743375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.743641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.743832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.753627] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1108.917816] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.918011] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.918152] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.918416] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.918732] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.918893] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.919019] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.919230] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.919372] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.919573] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1108.919687] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.919792] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.919899] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.920014] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1108.920119] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.920247] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.941062] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.941062] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1108.941062] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.941062] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.941321] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-08a75e0f-b747-44ee-af81-6adbf38ae40c taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.941464] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-08a75e0f-b747-44ee-af81-6adbf38ae40c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.941589] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-08a75e0f-b747-44ee-af81-6adbf38ae40c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.941922] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-08a75e0f-b747-44ee-af81-6adbf38ae40c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.942078] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08a75e0f-b747-44ee-af81-6adbf38ae40c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.985841] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1108.986115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.119258] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.119437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.119437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.119718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.119718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.119960] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.120052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.120103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.120292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.120363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.120456] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1109.155888] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.156101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.156190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.156414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.156680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.168501] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1109.255568] env[66854]: INFO networking_nsxv3.common.synchronization [req-ff988284-a1f5-453d-b239-95e6719642c6 req-b5948788-ca46-4104-a35b-bacd76b30bfc tempest-ServerRescueNegativeTestJSON-1659784790 tempest-ServerRescueNegativeTestJSON-1659784790-project-member] Enqueued Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 1109.256226] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGHEST for action security_group_members [ 1109.256607] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.256749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.256823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.257050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.257225] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.257334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.257398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.257608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.257699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.257799] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.444931] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.445447] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.445625] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.446120] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.446612] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.446805] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 08a75e0f-b747-44ee-af81-6adbf38ae40c not found, creating... [ 1109.447358] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.447696] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.447931] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.448389] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.448673] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.449107] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.449410] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.449647] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.449999] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.450214] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.450482] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 08a75e0f-b747-44ee-af81-6adbf38ae40c is going to be created. [ 1109.472372] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.472705] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.472911] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.473363] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.473701] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.474027] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-08a75e0f-b747-44ee-af81-6adbf38ae40c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.671531] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.671761] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.671899] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.672261] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.672611] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.672797] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.672919] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.673201] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.673352] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.673560] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.673676] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.673817] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.673950] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.674065] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.674199] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.674344] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.697848] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.698013] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.698162] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.698340] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.698726] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-86ed4d5b-7987-44e6-bae5-7574346f2c06 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.698961] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-86ed4d5b-7987-44e6-bae5-7574346f2c06" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.699086] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-86ed4d5b-7987-44e6-bae5-7574346f2c06" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.699481] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-86ed4d5b-7987-44e6-bae5-7574346f2c06" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.699645] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ed4d5b-7987-44e6-bae5-7574346f2c06',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.759758] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.759951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.759991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.760314] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.782947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.783388] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.783565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.783642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.783893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.783976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.784087] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 is going to be updated. [ 1109.821764] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.822013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.822013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.822162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.822330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.832173] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: IN_PROGRESS for 2s [ 1110.194582] env[66854]: INFO networking_nsxv3.common.synchronization [req-89932d52-796f-47bf-a363-1f61822e8953 req-de0beb9b-1e84-46ac-9bbc-fcf459212c25 service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 1110.194845] env[66854]: INFO networking_nsxv3.common.synchronization [req-89932d52-796f-47bf-a363-1f61822e8953 req-de0beb9b-1e84-46ac-9bbc-fcf459212c25 service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1110.194908] env[66854]: INFO networking_nsxv3.common.synchronization [req-89932d52-796f-47bf-a363-1f61822e8953 req-de0beb9b-1e84-46ac-9bbc-fcf459212c25 service nova] Enqueued Resource ID: 08a75e0f-b747-44ee-af81-6adbf38ae40c with Priority: HIGHEST for action port [ 1110.195754] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 1110.195884] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1110.196124] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08a75e0f-b747-44ee-af81-6adbf38ae40c with Priority: HIGHEST for action port [ 1110.196889] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.197097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.197197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.197437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.197571] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.198518] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.198657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.198896] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-08a75e0f-b747-44ee-af81-6adbf38ae40c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.199034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08a75e0f-b747-44ee-af81-6adbf38ae40c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.199120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08a75e0f-b747-44ee-af81-6adbf38ae40c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.199376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08a75e0f-b747-44ee-af81-6adbf38ae40c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.200684] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08a75e0f-b747-44ee-af81-6adbf38ae40c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.202247] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.202432] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.202554] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.202833] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.202978] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.203145] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 86ed4d5b-7987-44e6-bae5-7574346f2c06 not found, creating... [ 1110.203400] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.203553] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.203668] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.204943] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.205250] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.205562] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.206042] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.206042] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.206184] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.206328] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.206524] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 86ed4d5b-7987-44e6-bae5-7574346f2c06 is going to be created. [ 1110.232248] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.232248] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.232248] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.232248] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.232248] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.232248] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-86ed4d5b-7987-44e6-bae5-7574346f2c06" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.702659] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.703036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.709653] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08a75e0f-b747-44ee-af81-6adbf38ae40c with status ACTIVE [ 1110.709653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.709653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.710635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.710836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.711636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.711636] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.711636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.711636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.712818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.712818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.712818] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.712818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.712818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.712818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.712818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.713203] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08a75e0f-b747-44ee-af81-6adbf38ae40c is going to be updated. [ 1110.737821] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.738077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.738077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.738318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.738464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.738644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08a75e0f-b747-44ee-af81-6adbf38ae40c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.774666] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1110.774814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.008385] env[66854]: INFO networking_nsxv3.common.synchronization [req-47d69bb0-a45a-42f4-afb3-d1412bfde9f9 req-0cbb62bd-8b76-4fb6-bd2a-e097e46dbfe8 service nova] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_rules [ 1111.008576] env[66854]: INFO networking_nsxv3.common.synchronization [req-47d69bb0-a45a-42f4-afb3-d1412bfde9f9 req-0cbb62bd-8b76-4fb6-bd2a-e097e46dbfe8 service nova] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1111.008734] env[66854]: INFO networking_nsxv3.common.synchronization [req-47d69bb0-a45a-42f4-afb3-d1412bfde9f9 req-0cbb62bd-8b76-4fb6-bd2a-e097e46dbfe8 service nova] Enqueued Resource ID: 86ed4d5b-7987-44e6-bae5-7574346f2c06 with Priority: HIGHEST for action port [ 1111.012697] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_rules [ 1111.012697] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1111.012697] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ed4d5b-7987-44e6-bae5-7574346f2c06 with Priority: HIGHEST for action port [ 1111.013321] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.013763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.013763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.013763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.013979] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.014850] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.014960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.015031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.015472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.015472] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.015605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.015648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.015785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.015882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.015973] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.017440] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-86ed4d5b-7987-44e6-bae5-7574346f2c06 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.017440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86ed4d5b-7987-44e6-bae5-7574346f2c06" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.017440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86ed4d5b-7987-44e6-bae5-7574346f2c06" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.017440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86ed4d5b-7987-44e6-bae5-7574346f2c06" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.017440] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ed4d5b-7987-44e6-bae5-7574346f2c06',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.179578] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1111.179823] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 1111.179945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.180144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.180384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.180595] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.180768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.180888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.181226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.181370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.181530] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.519053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.519226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.519462] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.520509] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86ed4d5b-7987-44e6-bae5-7574346f2c06 with status ACTIVE [ 1111.520737] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.520869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.520955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.521213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.521331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.521747] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.521747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.521851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.521958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.522061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.522285] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.522405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.522480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.522656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.522737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.522827] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86ed4d5b-7987-44e6-bae5-7574346f2c06 is going to be updated. [ 1111.546149] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.546429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.546522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.546748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.546894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.547084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86ed4d5b-7987-44e6-bae5-7574346f2c06" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.684068] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.844283] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 in Status: SUCCESS [ 1111.844283] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 deletion is rescheduled due to dependency. [ 1111.844283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.024844] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.186458] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.528653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.528653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.528653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.528653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.528653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.528913] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1112.563189] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.563822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.563822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.563822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.563971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.573759] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1112.690507] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.690704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.690749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.690978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.691080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.691186] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1112.736162] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.736347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.736435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.736652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.736823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.748061] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1113.884837] env[66854]: INFO networking_nsxv3.common.synchronization [req-0b349949-7d9d-4174-a7cd-45491c87231b req-ef7442dc-5e59-4060-a13d-fd3db715ddf9 tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1113.885636] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1113.886199] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.886199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.886199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.886413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.886413] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.886506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.886571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.886720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.886806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.886906] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.389368] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.584483] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1114.584767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.584987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.585291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.585536] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.585669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.585737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.586038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.586083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.586152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.586318] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.760175] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1114.760592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.760878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.761217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.761570] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.761803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.763025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.763025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.763025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.763025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.763025] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.892314] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.090377] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.090910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.090910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.090910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.091053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.091105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.091137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.091275] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.091368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.091510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.091599] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.091689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.091748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.092411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.092411] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.092411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.092411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.092411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.092411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.092411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.092681] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.265039] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.265256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.265256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.266710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.266710] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.266710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.266710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.266710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.266710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.266710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.266710] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.267043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.267043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.267043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.267709] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.267709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.267709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.267709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.267709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.267709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.267709] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.396118] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.396422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.396496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.396670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.396763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.396885] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1115.427425] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.427573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.427696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.428122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.428122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.438272] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1115.600040] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a25ac3d-b904-4054-a34f-271c7b608728: rpc.has_security_group_logging(os_id): False [ 1115.617852] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.618188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.619647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.619647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.619647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.619647] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.619647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.619647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.619647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.619647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.619647] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.619647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.619647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.621837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.621837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.621837] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.621837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.621837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.621837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.621837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.621837] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1115.692760] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.692898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.693020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.694023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.694023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.709596] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1115.769721] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab5dfec-4c69-486f-983d-2ea9413eccfa: rpc.has_security_group_logging(os_id): False [ 1115.801448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.803495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.803495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.803495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.803495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.803495] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.803495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.803495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.805481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.805481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.805481] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.805481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.805720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.805720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.805793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.806078] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.810122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.810320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.810604] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.810704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.810815] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1115.929363] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.930090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.930090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.930090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.930201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.957839] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1116.766199] env[66854]: INFO networking_nsxv3.common.synchronization [req-c54c2d1e-4277-423c-a7f2-c7aa59910f4c req-aec230bf-9572-4ab4-b333-f76f71efacd5 tempest-ImagesTestJSON-1862869845 tempest-ImagesTestJSON-1862869845-project-member] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1116.766780] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGHEST for action security_group_members [ 1116.767108] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.768145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.768145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.768145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.768145] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.768145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.768145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.768145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.768535] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.768697] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.272323] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.272603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.272603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.272748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.272827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.273056] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.273234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.273311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.273820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.273820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.273820] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be updated. [ 1117.347131] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.348100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.348100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.351660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.351660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.360133] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: IN_PROGRESS for 2s [ 1117.448344] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1117.449422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.727657] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1117.727901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.974032] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1117.974291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.369658] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 in Status: SUCCESS [ 1119.369951] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 deletion is rescheduled due to dependency. [ 1119.369951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.769042] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1121.769289] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1122.533746] env[66854]: INFO networking_nsxv3.common.synchronization [req-79bb393b-c423-419c-b54a-ca30e912f2d5 req-9d2b0799-b32d-43fb-ad0a-ac1e5b756158 tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1122.534318] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1122.534640] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.534757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.534824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.535108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.535287] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.535393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.535459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.535617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.535702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.535852] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.038405] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.038823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.038823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.038897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.038924] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.039138] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.039240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.039305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.039454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.039531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.039621] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1123.076043] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.076043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.076227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.076345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.076545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.085843] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1123.650123] env[66854]: INFO networking_nsxv3.common.synchronization [req-81cc3253-f2f1-4ac5-bc07-970a24ee5e1b req-19bc4159-9701-4e96-9372-8b63fcd02b31 tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1123.650123] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1123.650123] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.650123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.650123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.650123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.650123] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.650123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.650123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.650123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.650123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.650588] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.977744] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-541 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.977950] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.978091] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.978362] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.978618] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.978774] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.978892] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.979119] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.979263] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.979467] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.979579] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.979687] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.979797] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.979903] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.980013] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.980150] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.000711] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.000882] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1124.001033] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.001263] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.001594] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-1c2831c9-8ca5-441b-a828-a155551a1939 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.001791] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-1c2831c9-8ca5-441b-a828-a155551a1939" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.002038] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-1c2831c9-8ca5-441b-a828-a155551a1939" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.002468] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-1c2831c9-8ca5-441b-a828-a155551a1939" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.002661] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c2831c9-8ca5-441b-a828-a155551a1939',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.105125] env[66854]: INFO networking_nsxv3.common.synchronization [req-1e322204-a8e3-4ad7-9dcd-f9d1917d1fb6 req-1fc20932-7993-43f6-b079-698d9991acc2 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1124.105749] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1124.106093] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.106218] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.106287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.106491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.106735] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.106853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.106920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.107094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.107181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.107276] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.155917] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.504629] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.504866] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.504985] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.505266] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.505422] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.505578] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 1c2831c9-8ca5-441b-a828-a155551a1939 not found, creating... [ 1124.505885] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.506055] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.506166] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.506394] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.506528] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.506802] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.506956] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.507081] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.507286] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.507416] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.507549] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 1c2831c9-8ca5-441b-a828-a155551a1939 is going to be created. [ 1124.528389] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.528589] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.528716] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.528994] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.529239] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.529467] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-1c2831c9-8ca5-441b-a828-a155551a1939" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.609885] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.658643] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.704195] env[66854]: INFO networking_nsxv3.common.synchronization [None req-2e4d01d5-bed4-4661-9f1f-dc6089c4ea2c tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1124.704767] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1124.705133] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.705245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.101184] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1125.101467] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 1125.101695] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.114661] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.162314] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.162634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.162634] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.163820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.163820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.163820] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1125.202976] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.203252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.203829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.203829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.203829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.219248] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1125.318357] env[66854]: INFO networking_nsxv3.common.synchronization [req-81cc3253-f2f1-4ac5-bc07-970a24ee5e1b req-cfc0baff-d83b-4a45-af5c-df6db83b93c9 service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 1125.318357] env[66854]: INFO networking_nsxv3.common.synchronization [req-81cc3253-f2f1-4ac5-bc07-970a24ee5e1b req-cfc0baff-d83b-4a45-af5c-df6db83b93c9 service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1125.318357] env[66854]: INFO networking_nsxv3.common.synchronization [req-81cc3253-f2f1-4ac5-bc07-970a24ee5e1b req-cfc0baff-d83b-4a45-af5c-df6db83b93c9 service nova] Enqueued Resource ID: 1c2831c9-8ca5-441b-a828-a155551a1939 with Priority: HIGHEST for action port [ 1125.318615] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 1125.318647] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1125.318759] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2831c9-8ca5-441b-a828-a155551a1939 with Priority: HIGHEST for action port [ 1125.319117] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.319207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.319285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.319502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.319577] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.320481] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.320597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.320761] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c2831c9-8ca5-441b-a828-a155551a1939 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.320857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c2831c9-8ca5-441b-a828-a155551a1939" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.321097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c2831c9-8ca5-441b-a828-a155551a1939" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.321097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c2831c9-8ca5-441b-a828-a155551a1939" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.321179] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c2831c9-8ca5-441b-a828-a155551a1939',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.615873] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.616115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.616185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.616755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.616755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.616755] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1125.647503] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.647665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.647838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.648149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.648305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.660862] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1125.822640] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.822776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.822994] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c2831c9-8ca5-441b-a828-a155551a1939 with status ACTIVE [ 1125.823237] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.823357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.823426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.823638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.823730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.823907] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.823994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.824067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.824256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.824320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.824519] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.824612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.824674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.824811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.824879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.824967] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c2831c9-8ca5-441b-a828-a155551a1939 is going to be updated. [ 1125.854567] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.854846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.854955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.855306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.855553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.855839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c2831c9-8ca5-441b-a828-a155551a1939" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.454982] env[66854]: INFO networking_nsxv3.common.synchronization [req-d367bac8-f2b9-4135-b0bf-7a3e1ba4acf1 req-5382921d-efae-4f3a-92f3-6709d1b4b561 tempest-ServersTestManualDisk-937553888 tempest-ServersTestManualDisk-937553888-project-member] Enqueued Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_members [ 1126.455537] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGHEST for action security_group_members [ 1126.455899] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-76446c38-ff50-4477-b278-800d793d9a4e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.456077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.456166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.456665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.456747] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.456841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.456899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.457128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.457212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.457333] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.959669] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.960023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.960193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.960586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.960751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.961152] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.961558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.961558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.961810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.961882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.962074] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76446c38-ff50-4477-b278-800d793d9a4e is going to be updated. [ 1126.993838] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.994095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.994095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.994285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.994431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.005678] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76446c38-ff50-4477-b278-800d793d9a4e in Status: IN_PROGRESS for 2s [ 1127.233774] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1127.234020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.234959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.234959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.234959] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.234959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.234959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.234959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.234959] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.235288] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.463114] env[66854]: INFO networking_nsxv3.common.synchronization [req-270251ae-a2ff-41b0-a531-d49c26e21813 req-ae86a930-3945-4428-a7e7-8bec569af601 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_members [ 1127.463690] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGHEST for action security_group_members [ 1127.464021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-845b53d6-5efd-417e-be55-cf8d579b97a7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.464191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.464261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.464473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.464666] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.464742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.464991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.464991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.465160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.465246] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.678458] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1127.678841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.679308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.679544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.679770] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.679895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.679963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.680133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.680285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.680395] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.738036] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.967701] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.967701] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.967701] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.967900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.988751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.989107] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.993025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.993025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.993025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.993025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.993025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 is going to be updated. [ 1128.022767] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.023036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.023036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.023214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.023361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.033942] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 in Status: IN_PROGRESS for 2s [ 1128.184194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.184194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.184194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.184194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.184194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.184194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.184194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.184550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.184550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.184550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.184644] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1128.216948] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.217111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.217169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.217373] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.217514] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.227907] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1128.241518] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.743470] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.743785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.743785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.743925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.744023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.744126] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1128.772259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.772383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.773143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.773143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.773143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.782099] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1129.015709] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76446c38-ff50-4477-b278-800d793d9a4e in Status: SUCCESS [ 1129.015900] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76446c38-ff50-4477-b278-800d793d9a4e deletion is rescheduled due to dependency. [ 1129.016011] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.043356] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 in Status: SUCCESS [ 1130.043579] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 deletion is rescheduled due to dependency. [ 1130.043671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.239041] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 4s [ 1130.792248] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1130.792458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.792458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.793030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.793030] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.793030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.793197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.794014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.794014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.794014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.794014] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.296682] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.297095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.297095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.297176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.297371] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.297461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.297529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.297694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.297785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.297877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.298046] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.298169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.298230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.298390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.298566] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.298695] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.298749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.298893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.298981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.299083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.299229] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.802336] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6779288d-3538-4416-9c3b-5f739846d8f3: rpc.has_security_group_logging(os_id): False [ 1131.822819] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.822819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.822819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.822819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.822819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.822819] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.822819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.822819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.822819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.822819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.822819] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.822819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.822819] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.823461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.823461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.823461] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.823461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.823461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.823655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.823655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.823655] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1131.888237] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.889138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.889138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.889138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.889138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.910372] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1132.251714] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1132.251943] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 deletion is rescheduled due to dependency. [ 1132.252086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.466065] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1132.466361] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1133.478669] env[66854]: INFO networking_nsxv3.common.synchronization [None req-dfe7b567-7b33-493a-9c63-60882d5845e8 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_rules [ 1133.479238] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_rules [ 1133.479573] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.479681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.479745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.480039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.480132] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.585730] env[66854]: INFO networking_nsxv3.common.synchronization [None req-14d9d879-70e9-4abb-904b-c2637e6405c4 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_rules [ 1133.586335] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_rules [ 1133.586688] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.586820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.927489] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1133.927710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.001330] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.001566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.001660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.001937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.002060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.002161] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 already deleted. [ 1134.002251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.002409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.002571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.002655] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.262648] env[66854]: INFO networking_nsxv3.common.synchronization [req-f3efe119-00f2-4269-afda-0e9f5636f4c1 req-68f289ed-9bd2-42af-863c-98ecede3c13b tempest-ServersNegativeTestJSON-789183655 tempest-ServersNegativeTestJSON-789183655-project-member] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 1134.262648] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGHEST for action security_group_members [ 1134.262648] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.262648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.262648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.262648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.262648] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.262648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.262648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.262648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.263563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.263563] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.521892] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.522269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.522269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.522405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.522489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.522586] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 already deleted. [ 1134.522681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.765613] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.765724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.765782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.766028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.766122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.766342] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.766443] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.766506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.766670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.766746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.766836] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 is going to be updated. [ 1134.793050] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.793050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.793050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.793352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.793515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.804839] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: IN_PROGRESS for 2s [ 1135.575050] env[66854]: INFO networking_nsxv3.common.synchronization [req-0688d782-b101-4edc-bfcc-01d2920534be req-2f0d9d4b-5ab1-462e-8c81-d6432aab1418 tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1135.575656] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1135.576136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.576136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.576233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.576504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.576685] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.576813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.576878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.577065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.577197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.577304] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.877830] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.878093] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.878238] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.878462] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.878724] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.878879] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.879493] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.879493] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.879493] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.879713] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.879826] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.879937] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.880098] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.880221] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.880331] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.880466] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.906013] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.906232] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.906396] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.906569] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-833" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.906890] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-d5306e57-d0e9-4653-b8fd-ee02c2d52da9 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.907080] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-d5306e57-d0e9-4653-b8fd-ee02c2d52da9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.907203] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-d5306e57-d0e9-4653-b8fd-ee02c2d52da9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.907569] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-d5306e57-d0e9-4653-b8fd-ee02c2d52da9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.907722] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5306e57-d0e9-4653-b8fd-ee02c2d52da9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.079638] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.079854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.079905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.080153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.080359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.080617] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.080729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.080796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.080996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.081100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.081197] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1136.107913] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.108128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.108128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.108272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.108410] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.116780] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1136.410495] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.410767] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.410896] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.411205] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.411359] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.411634] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port d5306e57-d0e9-4653-b8fd-ee02c2d52da9 not found, creating... [ 1136.411788] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.411955] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.412059] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.412279] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.412416] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.412700] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.412855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.412971] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.413261] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.413403] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.413549] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: d5306e57-d0e9-4653-b8fd-ee02c2d52da9 is going to be created. [ 1136.452101] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.452331] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.452482] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.452781] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.452974] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.453275] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-d5306e57-d0e9-4653-b8fd-ee02c2d52da9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.815181] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 in Status: SUCCESS [ 1136.815476] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 deletion is rescheduled due to dependency. [ 1136.815476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.143535] env[66854]: INFO networking_nsxv3.common.synchronization [req-0688d782-b101-4edc-bfcc-01d2920534be req-a06e0043-5eb4-4bfb-8a91-d8aec87adc8e service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 1137.143907] env[66854]: INFO networking_nsxv3.common.synchronization [req-0688d782-b101-4edc-bfcc-01d2920534be req-a06e0043-5eb4-4bfb-8a91-d8aec87adc8e service nova] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1137.144158] env[66854]: INFO networking_nsxv3.common.synchronization [req-0688d782-b101-4edc-bfcc-01d2920534be req-a06e0043-5eb4-4bfb-8a91-d8aec87adc8e service nova] Enqueued Resource ID: d5306e57-d0e9-4653-b8fd-ee02c2d52da9 with Priority: HIGHEST for action port [ 1137.144866] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_rules [ 1137.145021] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1137.145197] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5306e57-d0e9-4653-b8fd-ee02c2d52da9 with Priority: HIGHEST for action port [ 1137.145486] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.145607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.145675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.145876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.146009] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.146897] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.146983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.147611] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5306e57-d0e9-4653-b8fd-ee02c2d52da9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.147851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5306e57-d0e9-4653-b8fd-ee02c2d52da9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.147851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5306e57-d0e9-4653-b8fd-ee02c2d52da9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.147990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5306e57-d0e9-4653-b8fd-ee02c2d52da9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.148086] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5306e57-d0e9-4653-b8fd-ee02c2d52da9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.651890] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.652055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.652296] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5306e57-d0e9-4653-b8fd-ee02c2d52da9 with status ACTIVE [ 1137.652481] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.652598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.652670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.652886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.653121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.653360] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.653479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.653551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.653745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.653836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.654059] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.654167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.654236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.654433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.654516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.654613] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5306e57-d0e9-4653-b8fd-ee02c2d52da9 is going to be updated. [ 1137.668624] env[66854]: INFO networking_nsxv3.common.synchronization [req-18d68643-d6e2-4a8d-b3a4-dfc3f3c7b552 req-76301ba6-fc6f-4973-98f4-f6f77ee5a0db tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1137.669221] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1137.669881] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.669881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.669881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.670062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.670097] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.670561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.670561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.670561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.670561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.670722] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.680078] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.680332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.680332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.680454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.680724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.680899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5306e57-d0e9-4653-b8fd-ee02c2d52da9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.127761] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1138.128143] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 1138.128143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.128321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.128605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.129757] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.129972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.130107] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.130370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.130507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.130686] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.173026] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.633369] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.676937] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.136028] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.180330] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.180489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.180603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.180789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.180885] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.181028] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1139.212122] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.212262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.212332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.212587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.212832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.224243] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1139.638328] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.639399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.639399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.639399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.639399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.639399] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1139.676444] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.676630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.676672] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.676876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.677028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.685836] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1141.234446] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1141.234759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.696435] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1141.696611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.696783] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.697014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.697243] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.697379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.697449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.697610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.697689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.697766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.697862] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.200179] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.200413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.200486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.200693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.200868] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.200989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.201076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.201242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.201418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.201418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.201589] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.201687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.201751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.201897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.202051] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.202161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.202225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.202369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.202462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.202545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.202637] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.670425] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1142.670823] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1142.705389] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab5dfec-4c69-486f-983d-2ea9413eccfa: rpc.has_security_group_logging(os_id): False [ 1142.724443] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.724654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.724718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.725140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.725268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.725526] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.725654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.725720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.725939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.726028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.726254] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.726365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.726436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.726616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.726693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.726927] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.727042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.727130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.727276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.727362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.727470] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1142.796250] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.796450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.796538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.796802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.797121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.814795] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1144.842884] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1144.843290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.311094] env[66854]: INFO networking_nsxv3.common.synchronization [req-48cf3038-4444-45fb-b15f-19f160e2e9db req-05692ef3-b303-4485-9998-300b981ee1a6 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1147.311768] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1147.312130] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.312280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.312344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.312636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.312813] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.312988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.312988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.313200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.313323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.313436] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.663527] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.663730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.663852] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.664231] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.664533] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.664806] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.665410] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.665410] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.665410] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.665682] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.665864] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.666022] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.666164] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.666337] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.666462] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.666627] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.688019] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.688228] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1147.688340] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.688512] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.688844] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-cb0f5092-78cc-465a-b704-ae04162acc76 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.689025] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-cb0f5092-78cc-465a-b704-ae04162acc76" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.689150] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-cb0f5092-78cc-465a-b704-ae04162acc76" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.689482] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-cb0f5092-78cc-465a-b704-ae04162acc76" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.689621] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb0f5092-78cc-465a-b704-ae04162acc76',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.816981] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.817165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.817235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.817456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.817545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.817770] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.817858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.817999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.818627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.818627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.818627] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 already deleted. [ 1147.818627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.192212] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.192491] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.192644] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.192928] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.193100] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.193246] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port cb0f5092-78cc-465a-b704-ae04162acc76 not found, creating... [ 1148.193506] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.193661] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.193784] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.194017] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.194155] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.194452] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.194583] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.194880] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.194968] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.195054] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.195213] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: cb0f5092-78cc-465a-b704-ae04162acc76 is going to be created. [ 1148.216702] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.216947] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.217122] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.217394] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.217652] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.217844] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-cb0f5092-78cc-465a-b704-ae04162acc76" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.899291] env[66854]: INFO networking_nsxv3.common.synchronization [req-48cf3038-4444-45fb-b15f-19f160e2e9db req-3a95478f-8232-4e12-97ef-08766de67ae3 service nova] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_rules [ 1148.899550] env[66854]: INFO networking_nsxv3.common.synchronization [req-48cf3038-4444-45fb-b15f-19f160e2e9db req-3a95478f-8232-4e12-97ef-08766de67ae3 service nova] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1148.899586] env[66854]: INFO networking_nsxv3.common.synchronization [req-48cf3038-4444-45fb-b15f-19f160e2e9db req-3a95478f-8232-4e12-97ef-08766de67ae3 service nova] Enqueued Resource ID: cb0f5092-78cc-465a-b704-ae04162acc76 with Priority: HIGHEST for action port [ 1148.900212] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_rules [ 1148.900298] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1148.900639] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb0f5092-78cc-465a-b704-ae04162acc76 with Priority: HIGHEST for action port [ 1148.900766] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.900766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.900857] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.901033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.901121] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.902941] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.902941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.902941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.902941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.902941] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.903212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.903212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.903212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.903303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.903335] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.904164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb0f5092-78cc-465a-b704-ae04162acc76 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.904164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb0f5092-78cc-465a-b704-ae04162acc76" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.904330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb0f5092-78cc-465a-b704-ae04162acc76" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.904364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb0f5092-78cc-465a-b704-ae04162acc76" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.904709] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb0f5092-78cc-465a-b704-ae04162acc76',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.406195] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.407342] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.407517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.407645] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb0f5092-78cc-465a-b704-ae04162acc76 with status ACTIVE [ 1149.407805] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.407864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.407930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.408156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.408246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.408411] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.408517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.408573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.408754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.408840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.409073] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.409171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.409234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.409376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.409451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.409537] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb0f5092-78cc-465a-b704-ae04162acc76 is going to be updated. [ 1149.430288] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.430510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.430510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.430664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.430807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.431022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb0f5092-78cc-465a-b704-ae04162acc76" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.911585] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.415501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.415501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.415501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.415767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.415796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.415946] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 is going to be created. [ 1150.441732] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.441732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.441944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.442044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.442172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.452061] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: UNINITIALIZED for 2s [ 1152.464915] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: SUCCESS [ 1152.464915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.465412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.465412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.465477] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.465645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.465757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.466030] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.466131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.466221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.466324] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.969153] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.474756] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69f6d823-e856-4d40-8105-f4f2f0010d02: rpc.has_security_group_logging(os_id): False [ 1153.492858] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.493105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.493105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.493283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.493375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.493611] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.493811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.493811] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.493943] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.493992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.494098] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 is going to be created. [ 1153.550247] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.550446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.550446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.550670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.550856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.561288] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: IN_PROGRESS for 2s [ 1153.901456] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1153.901584] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1154.801706] env[66854]: INFO networking_nsxv3.common.synchronization [req-020b9170-6803-41d4-b082-0fbfa619f8d1 req-2a89e53b-fdfb-49c4-8ee7-235dc1f1ca97 tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1154.802264] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1154.802598] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.802732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.802841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.802978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.803149] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.803252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.803316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.803472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.803557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.803655] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.067186] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-541 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.067416] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.067521] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.067812] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.068175] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.068282] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.068374] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.068671] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.068873] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.069106] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.069223] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.069366] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.069509] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.069632] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.069738] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.069918] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.090728] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.090912] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1155.091085] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.091204] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-541" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.091517] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-85333fd5-1ea2-4554-906a-17e742053202 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.091689] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-85333fd5-1ea2-4554-906a-17e742053202" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.091804] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-85333fd5-1ea2-4554-906a-17e742053202" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.092150] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-85333fd5-1ea2-4554-906a-17e742053202" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.092289] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85333fd5-1ea2-4554-906a-17e742053202',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.306473] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.573874] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: SUCCESS [ 1155.574110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.594850] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.595153] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.595244] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.595566] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.595719] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.596131] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 85333fd5-1ea2-4554-906a-17e742053202 not found, creating... [ 1155.596382] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.596520] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.596693] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.596942] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.597096] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.597399] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.597556] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.597671] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.597886] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.598028] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.598170] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 85333fd5-1ea2-4554-906a-17e742053202 is going to be created. [ 1155.622531] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.622772] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.622817] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.623101] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.623334] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.623593] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-85333fd5-1ea2-4554-906a-17e742053202" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.808918] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.305310] env[66854]: INFO networking_nsxv3.common.synchronization [req-020b9170-6803-41d4-b082-0fbfa619f8d1 req-517c1a23-7a15-4adb-a420-324b7bf23c37 service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 1156.305499] env[66854]: INFO networking_nsxv3.common.synchronization [req-020b9170-6803-41d4-b082-0fbfa619f8d1 req-517c1a23-7a15-4adb-a420-324b7bf23c37 service nova] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1156.305649] env[66854]: INFO networking_nsxv3.common.synchronization [req-020b9170-6803-41d4-b082-0fbfa619f8d1 req-517c1a23-7a15-4adb-a420-324b7bf23c37 service nova] Enqueued Resource ID: 85333fd5-1ea2-4554-906a-17e742053202 with Priority: HIGHEST for action port [ 1156.306476] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_rules [ 1156.306671] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1156.306748] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85333fd5-1ea2-4554-906a-17e742053202 with Priority: HIGHEST for action port [ 1156.307084] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.307221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.307290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.307540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.307585] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.308680] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.308772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.308987] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-85333fd5-1ea2-4554-906a-17e742053202 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.309450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85333fd5-1ea2-4554-906a-17e742053202" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.309450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85333fd5-1ea2-4554-906a-17e742053202" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.309558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85333fd5-1ea2-4554-906a-17e742053202" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.309623] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85333fd5-1ea2-4554-906a-17e742053202',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.311320] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.311320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.311320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.312744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.312744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.312744] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1156.342725] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.342893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.343016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.343327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.343837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.355110] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1156.812059] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.812401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.813505] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85333fd5-1ea2-4554-906a-17e742053202 with status ACTIVE [ 1156.813686] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.813804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.813868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.814099] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.814205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.814406] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.814914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.814914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.814914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.814914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.815180] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.815180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.815180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.815481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.815481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.815481] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85333fd5-1ea2-4554-906a-17e742053202 is going to be updated. [ 1156.838259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.838512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.838512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.838795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.838795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.838970] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85333fd5-1ea2-4554-906a-17e742053202" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.371107] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1158.371526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.371526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.371680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.372033] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.372158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.372225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.372396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.372480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.372588] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.875322] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.377365] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.879832] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.880171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.880171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.880929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.880929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.880929] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1159.911074] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.911308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.911384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.911597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.911744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.920800] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1161.307672] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1161.308159] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1161.932619] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1161.932619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.932766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.933700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.933700] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.933700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.933700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.933700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.933700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.933700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.934113] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.436626] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.437027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.437027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.437248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.437400] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.437626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.437626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.437696] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.437758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.437848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.437999] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.438114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.438183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.438334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.438483] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.438577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.438631] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.438756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.438832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.438914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.439024] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.704829] env[66854]: INFO networking_nsxv3.common.synchronization [req-70047e9d-d419-41df-ac0c-19ec4e1748b7 req-49459026-b64b-4be5-81e2-a8d663415f44 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1162.705367] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1162.705673] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.705797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.705863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.706073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.706243] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.706345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.706406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.706557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.706638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.706890] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.941728] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6779288d-3538-4416-9c3b-5f739846d8f3: rpc.has_security_group_logging(os_id): False [ 1162.960972] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.961100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.961199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.961388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.961480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.961712] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.961810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.961872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.962782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.962942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.963283] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.963452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.963588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.963799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.963920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.964193] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.964378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.964478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.964667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.964790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.964915] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1163.026862] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.027077] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.027199] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.028106] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.028106] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.028106] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.028297] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.028370] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.028510] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.028729] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.028988] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.028988] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.029092] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.029175] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.029466] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.029466] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.032497] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.032612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.032676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.032836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.032972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.049078] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1163.057593] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.057771] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1163.057911] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.058095] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.058477] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-d7a3c213-90e2-468b-981e-a04998979cf3 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.058688] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-d7a3c213-90e2-468b-981e-a04998979cf3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.058856] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-d7a3c213-90e2-468b-981e-a04998979cf3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.059214] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-d7a3c213-90e2-468b-981e-a04998979cf3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.059372] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a3c213-90e2-468b-981e-a04998979cf3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.209326] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.561678] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.562094] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.562094] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.562422] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.562578] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.562750] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port d7a3c213-90e2-468b-981e-a04998979cf3 not found, creating... [ 1163.563099] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.563298] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.563416] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.563632] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.563770] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.564103] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.564321] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.564487] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.564676] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.564815] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.564969] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: d7a3c213-90e2-468b-981e-a04998979cf3 is going to be created. [ 1163.586260] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.586529] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.586677] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.586950] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.587197] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.587414] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-d7a3c213-90e2-468b-981e-a04998979cf3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.712106] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.214654] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.214853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.214920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.215300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.215353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.215464] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 is going to be updated. [ 1164.244210] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.244411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.244463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.244694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.244832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.254794] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: IN_PROGRESS for 2s [ 1164.279015] env[66854]: INFO networking_nsxv3.common.synchronization [req-70047e9d-d419-41df-ac0c-19ec4e1748b7 req-cb1a9cfa-c15a-4006-87a8-2d4c5b5a91ea service nova] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_rules [ 1164.279200] env[66854]: INFO networking_nsxv3.common.synchronization [req-70047e9d-d419-41df-ac0c-19ec4e1748b7 req-cb1a9cfa-c15a-4006-87a8-2d4c5b5a91ea service nova] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1164.279341] env[66854]: INFO networking_nsxv3.common.synchronization [req-70047e9d-d419-41df-ac0c-19ec4e1748b7 req-cb1a9cfa-c15a-4006-87a8-2d4c5b5a91ea service nova] Enqueued Resource ID: d7a3c213-90e2-468b-981e-a04998979cf3 with Priority: HIGHEST for action port [ 1164.279863] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_rules [ 1164.280012] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1164.280113] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a3c213-90e2-468b-981e-a04998979cf3 with Priority: HIGHEST for action port [ 1164.280388] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.280509] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.280579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.280780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.280866] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.282031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.282031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.282177] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7a3c213-90e2-468b-981e-a04998979cf3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.282239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7a3c213-90e2-468b-981e-a04998979cf3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.282268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7a3c213-90e2-468b-981e-a04998979cf3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.282444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7a3c213-90e2-468b-981e-a04998979cf3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.282521] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a3c213-90e2-468b-981e-a04998979cf3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.784694] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.785076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.785076] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7a3c213-90e2-468b-981e-a04998979cf3 with status ACTIVE [ 1164.785171] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.785271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.785340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.785540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.785627] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.785818] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.785883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.785950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.786121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.786202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.786388] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.786499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.786563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.786703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.786778] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.786861] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7a3c213-90e2-468b-981e-a04998979cf3 is going to be updated. [ 1164.808339] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.808583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.808583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.808723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.808851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.809020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7a3c213-90e2-468b-981e-a04998979cf3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.062390] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1165.062607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.264753] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: IN_PROGRESS for 4s [ 1168.276106] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: SUCCESS [ 1168.276526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.276526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.276766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.276938] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.277074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.277074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.277251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.277368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.277472] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.780265] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.281319] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1169.281675] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1169.282928] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.786963] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.787200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.787265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.787448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.787542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.787644] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 is going to be updated. [ 1169.815101] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.815331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.815331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.815525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.815662] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.825534] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: IN_PROGRESS for 2s [ 1170.772446] env[66854]: INFO networking_nsxv3.common.synchronization [req-a778366e-4b79-4afd-8b02-251421d64708 req-26cc0415-035b-4a5f-9e48-f7ad05de625e tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1170.772446] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1170.773448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.773448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.773448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.773448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.773448] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.773448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.773448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.773448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.773448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.773808] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.275384] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.779049] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.839092] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: SUCCESS [ 1171.839315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.839586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.839910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.840226] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.840426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.840528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.840741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.840851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.840978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.841122] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.281955] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.282113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.282190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.282405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.282497] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.282600] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1172.313694] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.313915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.313972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.314226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.314449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.324078] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1172.343625] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.846578] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69f6d823-e856-4d40-8105-f4f2f0010d02: rpc.has_security_group_logging(os_id): False [ 1172.863066] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.863275] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.863275] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.863545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.863641] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.864021] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.864136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.864204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.864365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.864445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.864538] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 is going to be updated. [ 1172.923216] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.923444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.923492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.923721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.923915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.936512] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: IN_PROGRESS for 2s [ 1173.966082] env[66854]: INFO networking_nsxv3.common.synchronization [None req-4cd2fbee-8533-4907-aea6-9bb844440691 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1173.966563] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1173.966867] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.966991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.967071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.967274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.967428] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.967527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.967591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.967743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.967830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.967926] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.336176] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1174.336450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.470605] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.470781] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.470864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.471117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.471219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.471435] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.471533] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.471595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.471763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.471864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.471961] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1174.504020] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.504168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.504252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.504461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.504602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.514362] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1174.956319] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: SUCCESS [ 1174.956565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.524435] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1176.524801] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 deletion is rescheduled due to dependency. [ 1176.524801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.967460] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1178.967832] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1179.697023] env[66854]: INFO networking_nsxv3.common.synchronization [req-3f300bd2-6392-4567-92dd-6eabc385414d req-f8705e91-9d55-42d5-9735-e64f9844e728 tempest-DeleteServersTestJSON-1931463905 tempest-DeleteServersTestJSON-1931463905-project-member] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1179.697023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGHEST for action security_group_members [ 1179.697555] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.697555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.697555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.697661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.697806] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.697919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.697982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.698152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.698236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.698330] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.202418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.202418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.202418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.202854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.202854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.202940] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.203354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.203354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.203469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.203469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.203568] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be updated. [ 1180.232576] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.232773] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.232832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.233055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.233202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.247261] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 2s [ 1180.383993] env[66854]: INFO networking_nsxv3.common.synchronization [req-fd9b8593-082b-4c38-8c29-350132ecd68e req-8ca20c20-1199-41af-8fb1-2e0a79896dd3 tempest-ServersTestJSON-1783928080 tempest-ServersTestJSON-1783928080-project-member] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1180.383993] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGHEST for action security_group_members [ 1180.384353] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.384476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.384544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.384748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.384904] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.385011] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.385078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.385229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.385311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.385407] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.888083] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.888272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.888272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.888499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.888575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.888787] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.888884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.888940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.889103] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.889182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.889269] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be updated. [ 1180.917279] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.917458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.917598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.917777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.917925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.926901] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: IN_PROGRESS for 2s [ 1182.257319] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: IN_PROGRESS for 4s [ 1182.938067] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6779288d-3538-4416-9c3b-5f739846d8f3 in Status: SUCCESS [ 1182.938067] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 deletion is rescheduled due to dependency. [ 1182.938067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.267810] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa in Status: SUCCESS [ 1184.268282] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa deletion is rescheduled due to dependency. [ 1184.268282] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.385215] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1185.385215] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1186.134613] env[66854]: INFO networking_nsxv3.common.synchronization [req-1fa0508c-40b4-45e5-96f5-4196663b06ce req-fd178ad1-263e-45d8-8e2d-ea1a9d47ab99 tempest-ServerActionsTestOtherB-456566424 tempest-ServerActionsTestOtherB-456566424-project-member] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1186.136164] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1186.136660] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.137833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.137833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.138085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.138255] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.138363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.138421] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.138579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.138684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.138784] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.642287] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.642287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.642287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.642287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.642287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.642287] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.642287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.642287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.643841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.643962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.644083] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1186.703755] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.703909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.704022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.704207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.704349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.713380] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1188.725172] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1188.725513] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 deletion is rescheduled due to dependency. [ 1188.725513] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.682533] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.682851] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.682851] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.683144] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.683447] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.683616] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.683735] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.683952] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.684116] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.684323] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1190.684442] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.684557] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.684656] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.684762] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1190.684865] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.684995] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.703551] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.703724] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1190.703867] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.704110] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.704433] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-f7101413-ef87-4ca0-8f59-71e2bd286dc5 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.704607] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.704726] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.705069] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.705206] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7101413-ef87-4ca0-8f59-71e2bd286dc5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.137081] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1191.137266] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1191.207083] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.207319] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.207439] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.207743] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.207929] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.208102] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port f7101413-ef87-4ca0-8f59-71e2bd286dc5 not found, creating... [ 1191.208369] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.208525] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.208644] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.208863] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.209010] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.209296] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.209447] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.209575] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.209807] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.209978] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.210142] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: f7101413-ef87-4ca0-8f59-71e2bd286dc5 is going to be created. [ 1191.234568] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.234816] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.234927] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.235224] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.235467] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.235690] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.939416] env[66854]: INFO networking_nsxv3.common.synchronization [req-5ef216f1-cb4d-46c4-a99b-3ac31fc2353a req-b6a9dd88-4b85-49b8-b9c4-60c6866839bc service nova] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_rules [ 1191.939683] env[66854]: INFO networking_nsxv3.common.synchronization [req-5ef216f1-cb4d-46c4-a99b-3ac31fc2353a req-b6a9dd88-4b85-49b8-b9c4-60c6866839bc service nova] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1191.939796] env[66854]: INFO networking_nsxv3.common.synchronization [req-5ef216f1-cb4d-46c4-a99b-3ac31fc2353a req-b6a9dd88-4b85-49b8-b9c4-60c6866839bc service nova] Enqueued Resource ID: f7101413-ef87-4ca0-8f59-71e2bd286dc5 with Priority: HIGHEST for action port [ 1191.940264] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_rules [ 1191.940402] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1191.940503] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7101413-ef87-4ca0-8f59-71e2bd286dc5 with Priority: HIGHEST for action port [ 1191.940823] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.940892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.940951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.941162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.941300] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.942110] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.942224] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.942293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.942454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.942606] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.942699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.942761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.942892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.942976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.943084] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.943807] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7101413-ef87-4ca0-8f59-71e2bd286dc5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.943909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.943985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.944267] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.944347] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7101413-ef87-4ca0-8f59-71e2bd286dc5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.447287] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.447894] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.448015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.449902] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7101413-ef87-4ca0-8f59-71e2bd286dc5 with status ACTIVE [ 1192.449902] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.449902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.449902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.450622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.450622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.450622] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.450622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.450622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.450622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.450947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.450947] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.450947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.450947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.451235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.451235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.451322] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7101413-ef87-4ca0-8f59-71e2bd286dc5 is going to be updated. [ 1192.471219] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.471507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.471507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.471626] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.471740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.471891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.949028] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.451413] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.451688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.451688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.451875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.451966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.452084] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1193.479961] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.480185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.480185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.480395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.480544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.489053] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1195.500039] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1195.500432] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.500432] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.500644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.500838] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.500955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.501033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.501193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.501298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.501392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.501487] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.004268] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.004508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.004659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.005020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.005290] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.005466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.005568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.005777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.005867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.005957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.006134] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.006229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.006291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.006433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.006571] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.006659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.006717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.006848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.006925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.007016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.007104] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.509281] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a25ac3d-b904-4054-a34f-271c7b608728: rpc.has_security_group_logging(os_id): False [ 1196.527421] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.527637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.527637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.527839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.527926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.528162] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.528263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.528323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.528501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.528583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.528770] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.528864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.528925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.529076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.529151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.529331] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.529426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.529483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.529618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.529691] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.529792] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1196.592863] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.593143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.593233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.593518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.593691] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.606538] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1196.941311] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1196.941463] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1196.968715] env[66854]: INFO networking_nsxv3.common.synchronization [req-a975c065-341d-437d-a2b3-88318d2e4d83 req-3ad71d73-0f1a-41dc-9043-a25f6046afb0 tempest-ServerActionsTestOtherB-456566424 tempest-ServerActionsTestOtherB-456566424-project-member] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1196.969299] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1196.969617] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.969739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.969836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.970026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.970192] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.970268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.970349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.970473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.970554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.970647] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.264358] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-323 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.264557] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.264684] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.264994] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.265623] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.265770] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.266357] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.266653] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.266852] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.267084] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1197.267202] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1197.267314] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1197.267426] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1197.267541] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1197.267649] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1197.267906] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1197.288440] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1197.288501] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1197.288701] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1197.288979] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.289462] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-e521d0b5-4db5-412b-a138-973785a6449e taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.289730] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.290010] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.290410] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.290579] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e521d0b5-4db5-412b-a138-973785a6449e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.472760] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.472948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.472948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.473208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.473337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.473545] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.473646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.473714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.473865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.473941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.474040] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1197.504325] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.504527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.504638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.504962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.505199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.515828] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1197.793886] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.794122] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.794167] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.794498] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.794660] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.794815] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port e521d0b5-4db5-412b-a138-973785a6449e not found, creating... [ 1197.795100] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.795263] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.795385] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.795700] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.795839] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.796152] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.796337] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.796463] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.796677] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.796812] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.796953] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: e521d0b5-4db5-412b-a138-973785a6449e is going to be created. [ 1197.818852] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.819100] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.819231] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.819916] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.820245] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.820463] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.600127] env[66854]: INFO networking_nsxv3.common.synchronization [req-a975c065-341d-437d-a2b3-88318d2e4d83 req-0ba50a00-731c-4728-a6f9-823648c60950 service nova] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 1198.600922] env[66854]: INFO networking_nsxv3.common.synchronization [req-a975c065-341d-437d-a2b3-88318d2e4d83 req-0ba50a00-731c-4728-a6f9-823648c60950 service nova] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1198.600922] env[66854]: INFO networking_nsxv3.common.synchronization [req-a975c065-341d-437d-a2b3-88318d2e4d83 req-0ba50a00-731c-4728-a6f9-823648c60950 service nova] Enqueued Resource ID: e521d0b5-4db5-412b-a138-973785a6449e with Priority: HIGHEST for action port [ 1198.601081] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 1198.601081] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1198.601180] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e521d0b5-4db5-412b-a138-973785a6449e with Priority: HIGHEST for action port [ 1198.601479] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.601600] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.601669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.601893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.601961] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.602846] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.602950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.603160] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e521d0b5-4db5-412b-a138-973785a6449e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.603284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.603346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.603522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.603598] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e521d0b5-4db5-412b-a138-973785a6449e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.619223] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1198.619453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.106273] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.106508] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.106559] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e521d0b5-4db5-412b-a138-973785a6449e with status ACTIVE [ 1199.106742] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.106849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.106941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.107146] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.107237] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.107418] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.107516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.107579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.107730] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.107810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.107989] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.108096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.108157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.108294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.108369] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.108685] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e521d0b5-4db5-412b-a138-973785a6449e is going to be updated. [ 1199.129944] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.130172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.130254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.130480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.130678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.130912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.307732] env[66854]: INFO networking_nsxv3.common.synchronization [None req-984e42a6-0562-417b-aabc-e936cd6c6cd3 tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_rules [ 1199.308443] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_rules [ 1199.308552] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-145b4f21-7695-4838-8836-f19d46e237a2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.308677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.308761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.309027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.309108] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.407126] env[66854]: INFO networking_nsxv3.common.synchronization [None req-d1113061-4cbd-4b6d-8e2a-6a001ea3c734 tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_rules [ 1199.407594] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_rules [ 1199.407945] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-145b4f21-7695-4838-8836-f19d46e237a2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.408066] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.527724] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1199.527902] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 deletion is rescheduled due to dependency. [ 1199.528034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.528202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.528421] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.528608] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.528724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.528788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.528937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.529031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.529126] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.829555] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.829884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.829884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.830060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.830152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.830276] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 145b4f21-7695-4838-8836-f19d46e237a2 already deleted. [ 1199.830363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.830534] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.830692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.830787] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.031211] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.352457] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.352645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.352690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.352888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.352990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.353098] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 145b4f21-7695-4838-8836-f19d46e237a2 already deleted. [ 1200.353216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.533721] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.036775] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.037110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.037110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.037247] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.037356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.037476] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1201.064806] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.065052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.065173] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.065490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.065736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.074255] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1203.084617] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1203.084979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.084979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.085210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.085404] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.085520] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.085587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.085751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.085830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.085898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.085989] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.588087] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.090155] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f976c-9aad-49d6-90f2-cd04bf828754: rpc.has_security_group_logging(os_id): False [ 1204.107830] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.108065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.108065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.108273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.108364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.108610] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.108724] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.108787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.108934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.109025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.109115] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1204.171254] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.171453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.171453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.171677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.171822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.184266] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1204.408981] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1204.409178] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1204.746574] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb93d78f-8065-433b-9eef-d958640c0b94 req-7942582c-dd83-40d6-b4f0-69c972c45160 tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_members [ 1204.747126] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_members [ 1204.747405] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-145b4f21-7695-4838-8836-f19d46e237a2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.747529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.747598] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.747855] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.748072] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.748187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.748255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.748409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.748492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.748588] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.049364] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.049364] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.049364] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.049364] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.049644] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.049819] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.049880] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.050176] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.050337] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.050549] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1205.050663] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1205.050770] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1205.050875] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1205.050981] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1205.051162] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1205.051248] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1205.074572] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1205.074572] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1205.074572] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1205.074572] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.074572] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.074572] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.074572] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.074572] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.074572] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.251511] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.251915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.251915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.251983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.252121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.252262] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.252375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.252441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.252624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.252705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.252762] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 145b4f21-7695-4838-8836-f19d46e237a2 already deleted. [ 1205.252842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.576896] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.577150] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.577281] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.577558] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.577704] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.577856] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd not found, creating... [ 1205.578126] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.578284] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.578399] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.578609] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.578741] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.579028] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.579184] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.579301] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.579600] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.579674] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.579758] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd is going to be created. [ 1205.601777] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.602015] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.602138] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.602454] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.602627] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.602856] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.200935] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1206.201195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.303485] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb93d78f-8065-433b-9eef-d958640c0b94 req-702daf9f-f308-4ba8-8d0c-195ebe4b18a0 service nova] Enqueued Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_rules [ 1206.303748] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb93d78f-8065-433b-9eef-d958640c0b94 req-702daf9f-f308-4ba8-8d0c-195ebe4b18a0 service nova] Enqueued Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_members [ 1206.303826] env[66854]: INFO networking_nsxv3.common.synchronization [req-eb93d78f-8065-433b-9eef-d958640c0b94 req-702daf9f-f308-4ba8-8d0c-195ebe4b18a0 service nova] Enqueued Resource ID: 4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd with Priority: HIGHEST for action port [ 1206.304415] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_rules [ 1206.304640] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_members [ 1206.304701] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd with Priority: HIGHEST for action port [ 1206.304965] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-145b4f21-7695-4838-8836-f19d46e237a2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.305380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.305529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.305806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.306018] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.308710] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-145b4f21-7695-4838-8836-f19d46e237a2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.308710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.308710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.308710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.308710] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.308710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.308710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.308710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.308710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.308710] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.310070] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.311043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.311043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.311043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.311043] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.813767] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.814736] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-145b4f21-7695-4838-8836-f19d46e237a2 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.814852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.815415] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd with status ACTIVE [ 1206.815415] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.815415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.815415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.815651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.815651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.816602] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.816602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.816602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.816602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.816602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.816602] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.816602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.816602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.816602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.816946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.816946] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd is going to be updated. [ 1206.840337] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.840490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.840549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.841067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.841067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.841067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f1a6d20-3cf8-4b6b-bfc7-3af939818fdd" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.319105] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.796719] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.796989] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.797220] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.797539] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.797876] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.798185] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.798330] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.798606] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.798758] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.799052] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1207.799192] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.799370] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.799511] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.799677] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1207.799842] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.800046] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.820422] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.820616] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1207.820721] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.820897] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.821302] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-f7101413-ef87-4ca0-8f59-71e2bd286dc5 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.821486] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.821602] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.821866] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.821997] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7101413-ef87-4ca0-8f59-71e2bd286dc5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.822989] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.823144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.823144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.823330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.823428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.823524] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 145b4f21-7695-4838-8836-f19d46e237a2 is going to be created. [ 1207.846995] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.847242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.847242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.847445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.847609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.858155] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 145b4f21-7695-4838-8836-f19d46e237a2 in Status: UNINITIALIZED for 2s [ 1208.325989] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.326527] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.326527] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.326922] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.327183] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.327635] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.327874] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.328082] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.328431] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.328669] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.329096] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.329384] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.329512] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.329760] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.329982] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.330242] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: f7101413-ef87-4ca0-8f59-71e2bd286dc5 is going to be updated. [ 1208.352919] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.353201] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.353310] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.353586] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.353781] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.354018] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.022846] env[66854]: INFO networking_nsxv3.common.synchronization [req-330d155d-6143-407d-8c1e-7be56483cc6a req-1e249ec5-135b-4e8f-8473-7f1224df7f7e service nova] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_rules [ 1209.022846] env[66854]: INFO networking_nsxv3.common.synchronization [req-330d155d-6143-407d-8c1e-7be56483cc6a req-1e249ec5-135b-4e8f-8473-7f1224df7f7e service nova] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1209.022846] env[66854]: INFO networking_nsxv3.common.synchronization [req-330d155d-6143-407d-8c1e-7be56483cc6a req-1e249ec5-135b-4e8f-8473-7f1224df7f7e service nova] Enqueued Resource ID: f7101413-ef87-4ca0-8f59-71e2bd286dc5 with Priority: HIGHEST for action port [ 1209.023429] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_rules [ 1209.023429] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1209.023544] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7101413-ef87-4ca0-8f59-71e2bd286dc5 with Priority: HIGHEST for action port [ 1209.023769] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.023894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.023972] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.024253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.024342] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.025176] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.025294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.025360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.025555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.026341] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.026341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.026341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.026341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.026341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.027356] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.027877] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7101413-ef87-4ca0-8f59-71e2bd286dc5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.027877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.027877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.027992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.027992] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7101413-ef87-4ca0-8f59-71e2bd286dc5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.530176] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.530461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.530542] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.531433] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7101413-ef87-4ca0-8f59-71e2bd286dc5 with status ACTIVE [ 1209.531690] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.531762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.531805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.531989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.532097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.532273] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.532365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.532419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.532576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.532653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.532828] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.532918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.532979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.533181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.533281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.533336] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7101413-ef87-4ca0-8f59-71e2bd286dc5 is going to be updated. [ 1209.553110] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.553318] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.553376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.553541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.553673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.553825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7101413-ef87-4ca0-8f59-71e2bd286dc5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.870874] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 145b4f21-7695-4838-8836-f19d46e237a2 in Status: SUCCESS [ 1209.871190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.871396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.871686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.871923] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.872093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.872190] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.872392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.872488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.872580] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.872676] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.035459] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.375028] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.537532] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.537928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.537928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.537999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.538102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.538206] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1210.570239] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.570449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.570449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.570582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.570721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.578372] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1210.877765] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 145b4f21-7695-4838-8836-f19d46e237a2: rpc.has_security_group_logging(os_id): False [ 1210.895335] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.895550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.895612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.895832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.895907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.896186] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.896306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.896365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.896490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.896551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.896644] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 145b4f21-7695-4838-8836-f19d46e237a2 is going to be created. [ 1210.956221] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.956407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.956469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.956714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.956936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.969337] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 145b4f21-7695-4838-8836-f19d46e237a2 in Status: IN_PROGRESS for 2s [ 1212.588628] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1212.588917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.589012] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.589267] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.589479] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.589646] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.589678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.589824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.589904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.590024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.590112] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.982146] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 145b4f21-7695-4838-8836-f19d46e237a2 in Status: SUCCESS [ 1212.982376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.092166] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.092385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.092385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.092620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.092836] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.092940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.092975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.093203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.093287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.093380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.093539] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.093628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.093690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.093889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.093968] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.094084] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.094149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.094292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.094365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.094445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.094538] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.596945] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a25ac3d-b904-4054-a34f-271c7b608728: rpc.has_security_group_logging(os_id): False [ 1213.614911] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.615093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.615171] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.615383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.615470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.615693] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.615787] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.615846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.615995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.616110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.616282] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.616375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.616436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.616573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.616648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.616823] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.616914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.616975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.617125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.617199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.617285] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1213.677024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.677024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.677024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.677280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.677316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.691853] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1214.024368] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1214.024368] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1215.706163] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1215.706605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.025712] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1219.026171] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1224.026412] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1224.026769] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1224.686424] env[66854]: INFO networking_nsxv3.common.synchronization [req-d55edb86-d8ae-4634-a624-cec154867e50 req-7a93bc75-44f3-4c90-aa82-575f21bee44f tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1224.687024] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1224.687346] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.687476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.687603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.687747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.687901] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.688013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.688073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.688233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.688319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.688457] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.191074] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.693480] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.195914] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.196330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.196330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.196429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.196544] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.196651] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 is going to be updated. [ 1226.225526] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.225713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.225713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.225876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.226027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.235752] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: IN_PROGRESS for 2s [ 1228.246828] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: SUCCESS [ 1228.247232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.688575] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1229.688575] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1231.014312] env[66854]: INFO networking_nsxv3.common.synchronization [req-98010d32-abd4-4103-b63e-0c9679edcb3f req-49a3c55f-2f86-44e9-adc6-0d9f75a80d7e tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1231.014559] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGHEST for action security_group_members [ 1231.014731] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.014851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.014917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.016024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.016024] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.016024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.016024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.016024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.016024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.016024] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.517788] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.518044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.518044] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.518283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.518406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.518633] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.518734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.518798] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.518990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.519087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.519180] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 is going to be updated. [ 1231.546824] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.547034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.547034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.547238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.547378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.555567] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: IN_PROGRESS for 2s [ 1233.566397] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 in Status: SUCCESS [ 1233.566802] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 deletion is rescheduled due to dependency. [ 1233.566802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.413503] env[66854]: INFO networking_nsxv3.common.synchronization [None req-c0054854-3235-4a0f-8d93-3b00e781a628 tempest-AttachInterfacesTestJSON-853117916 tempest-AttachInterfacesTestJSON-853117916-project-member] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1235.414094] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGHEST for action security_group_members [ 1235.414354] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.414466] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.414530] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.414728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.414904] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.415020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.415075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.415276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.415355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.415449] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.918013] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.918220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.918220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.918559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.918715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.919117] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.919181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.919300] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.919556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.919695] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.919863] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be updated. [ 1235.950584] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.950833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.950833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.951073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.951246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.959492] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: IN_PROGRESS for 2s [ 1237.971037] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a25ac3d-b904-4054-a34f-271c7b608728 in Status: SUCCESS [ 1237.971333] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 deletion is rescheduled due to dependency. [ 1237.971377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.228182] env[66854]: INFO networking_nsxv3.common.synchronization [None req-7c0e1bff-5f4a-49d9-9804-36af04667a63 None None] Enqueued Resource ID: 0650aa46-0c35-4ef5-8135-a45236e00078 with Priority: HIGHEST for action port [ 1239.229103] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0650aa46-0c35-4ef5-8135-a45236e00078 with Priority: HIGHEST for action port [ 1239.229607] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-0650aa46-0c35-4ef5-8135-a45236e00078 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.231471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0650aa46-0c35-4ef5-8135-a45236e00078" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.231471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0650aa46-0c35-4ef5-8135-a45236e00078" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.231471] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0650aa46-0c35-4ef5-8135-a45236e00078" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.231471] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0650aa46-0c35-4ef5-8135-a45236e00078',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.733486] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0650aa46-0c35-4ef5-8135-a45236e00078 [ 1239.733729] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.733887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.733963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.734195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.734285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.734384] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0650aa46-0c35-4ef5-8135-a45236e00078 already deleted. [ 1239.734464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0650aa46-0c35-4ef5-8135-a45236e00078" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.818946] env[66854]: INFO networking_nsxv3.common.synchronization [None req-518a91fe-6001-40be-8382-12ecd9affda9 tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_rules [ 1239.820029] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_rules [ 1239.820029] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c77425c2-9b5e-4d53-92ee-45328ba247f6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.820398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.820517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.820843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.821012] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.906676] env[66854]: INFO networking_nsxv3.common.synchronization [None req-df471449-d0e9-4c4d-989f-35b2e54e3b8a tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_rules [ 1239.907153] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_rules [ 1239.907462] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c77425c2-9b5e-4d53-92ee-45328ba247f6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.907578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.345797] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.345797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.345797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.345797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.345797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.346339] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 already deleted. [ 1240.346339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.346339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.346510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.346607] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.867383] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.867383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.867383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.867383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.867383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.867383] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 already deleted. [ 1240.867383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.422633] env[66854]: INFO networking_nsxv3.common.synchronization [None req-6aca8f5d-6eae-42d2-ac58-af7c0154a4ff None None] Enqueued Resource ID: 8ccfe540-4f71-4d0a-8d8f-479f1e8713e1 with Priority: HIGHEST for action port [ 1241.422980] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ccfe540-4f71-4d0a-8d8f-479f1e8713e1 with Priority: HIGHEST for action port [ 1241.423511] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ccfe540-4f71-4d0a-8d8f-479f1e8713e1 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.423643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ccfe540-4f71-4d0a-8d8f-479f1e8713e1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.423712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ccfe540-4f71-4d0a-8d8f-479f1e8713e1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.424037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ccfe540-4f71-4d0a-8d8f-479f1e8713e1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.424122] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ccfe540-4f71-4d0a-8d8f-479f1e8713e1',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.926190] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ccfe540-4f71-4d0a-8d8f-479f1e8713e1 [ 1241.926424] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.926557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.926625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.926853] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.926948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.927063] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ccfe540-4f71-4d0a-8d8f-479f1e8713e1 already deleted. [ 1241.927160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ccfe540-4f71-4d0a-8d8f-479f1e8713e1" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.294170] env[66854]: INFO networking_nsxv3.common.synchronization [req-f589ce16-d73b-4a19-a9fe-8ef137e259fd req-00ef7429-907e-47e6-9572-23fa3dc67815 tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_members [ 1245.294712] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_members [ 1245.295027] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c77425c2-9b5e-4d53-92ee-45328ba247f6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.295187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.295256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.295493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.295653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.295751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.295838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.296399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.296482] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.296547] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.599476] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.599663] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.599782] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.600138] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.600399] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.600566] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.600677] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.600895] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.601106] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.601322] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1245.601435] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1245.601541] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1245.601644] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1245.601756] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1245.601853] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1245.601982] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1245.622310] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1245.622479] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1245.622617] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1245.622820] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.623158] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.623331] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.623449] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.623760] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.623921] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.799406] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.799688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.799903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.800236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.800344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.800570] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.800689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.800749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.800960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.801026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.801112] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 already deleted. [ 1245.801194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.126588] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.126822] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.126950] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.127271] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.127423] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.127574] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17 not found, creating... [ 1246.127832] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.127987] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.128116] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.128323] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.128458] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.128729] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.128884] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.128996] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.129211] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.129343] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.129480] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17 is going to be created. [ 1246.150009] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.150359] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.150488] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.150759] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.151019] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.151269] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.713868] env[66854]: INFO networking_nsxv3.common.synchronization [req-f589ce16-d73b-4a19-a9fe-8ef137e259fd req-bd5f040d-7414-4663-9565-7a632e205c0a service nova] Enqueued Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_rules [ 1247.714154] env[66854]: INFO networking_nsxv3.common.synchronization [req-f589ce16-d73b-4a19-a9fe-8ef137e259fd req-bd5f040d-7414-4663-9565-7a632e205c0a service nova] Enqueued Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_members [ 1247.714223] env[66854]: INFO networking_nsxv3.common.synchronization [req-f589ce16-d73b-4a19-a9fe-8ef137e259fd req-bd5f040d-7414-4663-9565-7a632e205c0a service nova] Enqueued Resource ID: 7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17 with Priority: HIGHEST for action port [ 1247.714707] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_rules [ 1247.714847] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_members [ 1247.714947] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17 with Priority: HIGHEST for action port [ 1247.715237] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c77425c2-9b5e-4d53-92ee-45328ba247f6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.715408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.715443] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.715616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.715726] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.716488] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c77425c2-9b5e-4d53-92ee-45328ba247f6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.716610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.716679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.716846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.716994] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.717098] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.717160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.717313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.717396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.717468] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.720277] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.720277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.720277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.720277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.720277] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.221896] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.222339] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c77425c2-9b5e-4d53-92ee-45328ba247f6 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.222450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.222622] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17 with status ACTIVE [ 1248.222775] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.222919] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.222984] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.223208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.223297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.223462] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.223560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.223622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.223774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.223867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.224531] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.224648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.224785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.224863] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.225064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.225165] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17 is going to be updated. [ 1248.248340] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.248481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.248593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.248748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.248888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.249058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d249e05-3ff3-4fd8-8bca-bd2ecfa11b17" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.727298] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.230028] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.231065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.231065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.231065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.231065] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.231065] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 is going to be created. [ 1249.258354] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.258583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.258583] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.258839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.259093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.268499] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 in Status: UNINITIALIZED for 2s [ 1251.279718] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 in Status: SUCCESS [ 1251.280159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.280252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.280449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.280709] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.280833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.280903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.281091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.281174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.281261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.281355] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.784365] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.287622] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c77425c2-9b5e-4d53-92ee-45328ba247f6: rpc.has_security_group_logging(os_id): False [ 1252.309395] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.309642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.309642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.309860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.309952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.310230] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.310339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.310393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.310561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.310684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.310771] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 is going to be created. [ 1252.383413] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.383708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.383795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.384134] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.384391] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.398218] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 in Status: IN_PROGRESS for 2s [ 1252.716603] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.716835] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1254.411711] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 in Status: SUCCESS [ 1254.412122] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.717727] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.718138] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1262.718518] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.718866] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1267.720030] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.720030] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1271.354307] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-323 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.354618] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.354618] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.355176] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.355588] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.355760] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.355881] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.356138] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.356293] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.357040] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1271.357040] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1271.357040] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1271.357040] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1271.357040] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1271.357040] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1271.357509] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.377631] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.377818] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1271.378022] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.378206] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-323" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.378618] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-e521d0b5-4db5-412b-a138-973785a6449e taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.378814] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.378936] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.379232] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.379369] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e521d0b5-4db5-412b-a138-973785a6449e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.882434] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.882659] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.882708] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.883081] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.883237] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.883517] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.883676] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.883794] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.884046] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.884192] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.884472] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.884629] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.884745] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.884950] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.885100] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.885242] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: e521d0b5-4db5-412b-a138-973785a6449e is going to be updated. [ 1271.905890] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.906167] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.906233] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.906470] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.906662] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.906881] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.577122] env[66854]: INFO networking_nsxv3.common.synchronization [req-666a5333-46e5-4f4c-bd6f-48cabc6deaa2 req-e4697fd0-cdd6-4486-bac0-aad3dd55ac2d service nova] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 1272.577363] env[66854]: INFO networking_nsxv3.common.synchronization [req-666a5333-46e5-4f4c-bd6f-48cabc6deaa2 req-e4697fd0-cdd6-4486-bac0-aad3dd55ac2d service nova] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1272.577486] env[66854]: INFO networking_nsxv3.common.synchronization [req-666a5333-46e5-4f4c-bd6f-48cabc6deaa2 req-e4697fd0-cdd6-4486-bac0-aad3dd55ac2d service nova] Enqueued Resource ID: e521d0b5-4db5-412b-a138-973785a6449e with Priority: HIGHEST for action port [ 1272.577717] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_rules [ 1272.577852] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1272.577953] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e521d0b5-4db5-412b-a138-973785a6449e with Priority: HIGHEST for action port [ 1272.578543] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.578620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.578690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.578906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.579044] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.580077] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.580226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.580226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.580360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.580504] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.580650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.580747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.580940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.581073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.581209] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.582168] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e521d0b5-4db5-412b-a138-973785a6449e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.582168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.582281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.582389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.582491] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e521d0b5-4db5-412b-a138-973785a6449e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.084837] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.085959] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.086141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.086260] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e521d0b5-4db5-412b-a138-973785a6449e with status ACTIVE [ 1273.086417] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.086522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.086587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.086789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.086877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.087057] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.087155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.087217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.087370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.087448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.087625] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.087716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.087777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.087912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.087980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.088075] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e521d0b5-4db5-412b-a138-973785a6449e is going to be updated. [ 1273.109093] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.109295] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.109295] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.109486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.109619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.109775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e521d0b5-4db5-412b-a138-973785a6449e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.590233] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.092935] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.093229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.093229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.093407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.093496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.093599] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1274.124080] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.124312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.124312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.124515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.124660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.135235] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1275.510545] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1275.510854] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:3 started [ 1276.147976] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1276.148542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.149027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.149540] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.149908] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.150141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.150277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.150491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.150602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.150718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.150856] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.654062] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.156658] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f976c-9aad-49d6-90f2-cd04bf828754: rpc.has_security_group_logging(os_id): False [ 1277.174748] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.175042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.175042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.176252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.176252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.176252] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.176252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.176252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.176252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.176252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.176252] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1277.240700] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.240896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.240975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.241266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.241454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.254673] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1277.578842] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.578842] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1279.274899] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1279.274899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.579649] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.580093] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1287.582736] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1287.583108] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1289.009115] env[66854]: INFO networking_nsxv3.common.synchronization [req-2c8b0346-be78-4d29-a617-29e8e9a65993 req-a441098e-8b5d-4483-a186-145c14571f18 tempest-ServerActionsTestOtherB-456566424 tempest-ServerActionsTestOtherB-456566424-project-member] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1289.009115] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGHEST for action security_group_members [ 1289.009115] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.009115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.009115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.009115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.009115] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.009115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.009115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.009115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.009115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.009115] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.506246] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.506467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.506515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.506759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.506856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.507103] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.507230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.507293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.507474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.507565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.507670] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be updated. [ 1289.538664] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.538883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.538927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.539169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.539313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.548068] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: IN_PROGRESS for 2s [ 1291.559550] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f976c-9aad-49d6-90f2-cd04bf828754 in Status: SUCCESS [ 1291.559550] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 deletion is rescheduled due to dependency. [ 1291.559550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.461434] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.461709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.461709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.461867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.461976] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.964404] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.466884] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.969525] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1293.969927] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1294.002286] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1294.002482] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1294.798409] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.798612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.798612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.798782] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.823015] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1294.825299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.826637] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1294.864156] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.864156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.864156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.864757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.878361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.879561] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1294.879925] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1294.880165] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1294.925025] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.925025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.925025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.925025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.925025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.925025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1295.001105] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.001105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.001105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.001105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.001105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.003225] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1295.069075] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.069075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.069075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.069075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.069075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.069608] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:37. [ 1295.069831] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'650f976c-9aad-49d6-90f2-cd04bf828754', '44b9fe7e-d139-4b46-925d-7947b4b3dac9', '69f6d823-e856-4d40-8105-f4f2f0010d02', '76446c38-ff50-4477-b278-800d793d9a4e', '6a25ac3d-b904-4054-a34f-271c7b608728', 'f9e85364-8cd8-4a16-8f5e-17eb2478a9b7', '789c0fa6-0949-4f7b-a35b-21a28f7a5386', '8c19902d-3838-4141-b1c1-8a0050b66720', '6779288d-3538-4416-9c3b-5f739846d8f3', '82708b01-13e8-453a-8492-93929a99b850', '1466949f-e84c-4398-88b8-456cc5ec401b', 'f8bfd71e-0706-4e38-94f5-8c8814c273e6', '004af225-cfe6-418e-bf9b-b21fc4fcd911', 'a491a51f-1883-4e2c-a822-89d817e590ca', '7025fd1c-e490-40e6-9db4-8ead9e399bb5', '1308feff-f29c-49ab-ba49-67f2be7bd392', '141d1a4a-af29-49fe-8321-94ad97de005a', '26ccc5a4-8c8a-445b-b37a-462c691c3639', 'ee66d96e-b19b-40e4-b459-52eebc42250e', '2102370c-50ee-4712-bad2-1dc6ac49ebb5', 'b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3', 'c77425c2-9b5e-4d53-92ee-45328ba247f6', '845b53d6-5efd-417e-be55-cf8d579b97a7', '145b4f21-7695-4838-8836-f19d46e237a2', '97e4bb3e-c69c-45a4-812a-564327f5ba24', 'bd8df7a7-7bdc-4ef6-8502-08f458c1982a', '9780d851-7ce4-4e40-ae84-ac55f3124f1e', 'db9d8667-c0a3-4930-8f4b-8672f1d358e9', '28e22ce0-3477-434c-a48d-67bbaaa395f5', '404f4fa4-39e5-44f2-b930-0c5f5853142c', 'f972a36b-9b6b-4a54-abd1-328458bb94ea', '6ab5dfec-4c69-486f-983d-2ea9413eccfa', '4147e97c-db2e-4b4d-a03e-ee42eaaab8e0', 'e609d95d-5be9-41f5-b37f-2462907e2f6a', '71d1134e-4384-4c31-836b-3726375f2c2c', 'a12683d9-3f0c-4d0e-adac-f42cb41ab395', '5b4083ca-5955-4d5e-bfa3-13977c48a75e'} {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1295.070118] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1295.091113] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.091654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.091875] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.093861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.093861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.093861] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1295.093861] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1295.093861] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1295.165031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.165031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.165031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.165748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.168869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.168869] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1295.168869] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1295.168869] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1295.168869] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1295.168869] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/37 resources of Type:Security Group Rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a491a51f-1883-4e2c-a822-89d817e590ca with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGH for action security_group_rules [ 1295.168869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f976c-9aad-49d6-90f2-cd04bf828754 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee66d96e-b19b-40e4-b459-52eebc42250e with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141d1a4a-af29-49fe-8321-94ad97de005a with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a491a51f-1883-4e2c-a822-89d817e590ca with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1466949f-e84c-4398-88b8-456cc5ec401b with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82708b01-13e8-453a-8492-93929a99b850 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6779288d-3538-4416-9c3b-5f739846d8f3 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c19902d-3838-4141-b1c1-8a0050b66720 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a25ac3d-b904-4054-a34f-271c7b608728 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 with Priority: HIGH for action security_group_rules [ 1299.006023] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76446c38-ff50-4477-b278-800d793d9a4e with Priority: HIGH for action security_group_rules [ 1299.011022] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f976c-9aad-49d6-90f2-cd04bf828754 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.011022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.011022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.011022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.011022] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f976c-9aad-49d6-90f2-cd04bf828754',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.011022] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f6d823-e856-4d40-8105-f4f2f0010d02 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.011022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.011022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.011022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.011022] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f6d823-e856-4d40-8105-f4f2f0010d02',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.011022] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.011022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.011022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.011022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.011022] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789c0fa6-0949-4f7b-a35b-21a28f7a5386',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.014626] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.014922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.016214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.016214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.016214] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7025fd1c-e490-40e6-9db4-8ead9e399bb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.016982] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.018253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.018253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.018253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.018519] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2102370c-50ee-4712-bad2-1dc6ac49ebb5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.019463] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee66d96e-b19b-40e4-b459-52eebc42250e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.020817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.020817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.020817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.020817] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee66d96e-b19b-40e4-b459-52eebc42250e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.020817] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ccc5a4-8c8a-445b-b37a-462c691c3639 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.020817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.021154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.021386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.021567] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ccc5a4-8c8a-445b-b37a-462c691c3639',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.022355] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-141d1a4a-af29-49fe-8321-94ad97de005a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.022595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.022807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.023077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.023255] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('141d1a4a-af29-49fe-8321-94ad97de005a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.024190] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a491a51f-1883-4e2c-a822-89d817e590ca taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.024475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.025262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.025262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.025262] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a491a51f-1883-4e2c-a822-89d817e590ca',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.025610] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1308feff-f29c-49ab-ba49-67f2be7bd392 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.026733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.026733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.026733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.026733] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1308feff-f29c-49ab-ba49-67f2be7bd392',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.026733] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-004af225-cfe6-418e-bf9b-b21fc4fcd911 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.026733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.027491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.027491] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.027491] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('004af225-cfe6-418e-bf9b-b21fc4fcd911',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.028019] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8bfd71e-0706-4e38-94f5-8c8814c273e6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.028153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.028271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.028365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.028446] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8bfd71e-0706-4e38-94f5-8c8814c273e6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.029272] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1466949f-e84c-4398-88b8-456cc5ec401b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.029372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.030388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.030388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.030388] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1466949f-e84c-4398-88b8-456cc5ec401b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.030388] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82708b01-13e8-453a-8492-93929a99b850 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.031088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.031088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.031088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.031088] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82708b01-13e8-453a-8492-93929a99b850',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.031366] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6779288d-3538-4416-9c3b-5f739846d8f3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.031472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.031551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.031769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.031847] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6779288d-3538-4416-9c3b-5f739846d8f3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.032748] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.032748] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.032892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.032926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.032992] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.033677] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c19902d-3838-4141-b1c1-8a0050b66720 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.033804] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.033870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.034028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.034130] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c19902d-3838-4141-b1c1-8a0050b66720',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.035027] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a25ac3d-b904-4054-a34f-271c7b608728 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.035127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.035127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.035255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.035332] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a25ac3d-b904-4054-a34f-271c7b608728',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.036104] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.036308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.036392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.037094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.037094] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44b9fe7e-d139-4b46-925d-7947b4b3dac9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.037388] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76446c38-ff50-4477-b278-800d793d9a4e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.037507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.037578] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.038128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.038221] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76446c38-ff50-4477-b278-800d793d9a4e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.547667] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.547667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.547667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.547667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.547667] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.547667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.547667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.547667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.548268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.548385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.548515] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.593371] env[66854]: INFO networking_nsxv3.common.synchronization [None req-1e7ea6e3-f18b-4cd0-ab72-6af606dc4009 None None] Enqueued Resource ID: 4bdb9acc-9f69-4cad-8ec2-80e21b69713b with Priority: HIGHEST for action port [ 1299.611267] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bdb9acc-9f69-4cad-8ec2-80e21b69713b with Priority: HIGHEST for action port [ 1299.612360] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.612532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.612697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.613159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.614490] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.614597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.614832] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bdb9acc-9f69-4cad-8ec2-80e21b69713b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.614927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bdb9acc-9f69-4cad-8ec2-80e21b69713b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.614990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bdb9acc-9f69-4cad-8ec2-80e21b69713b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.615272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bdb9acc-9f69-4cad-8ec2-80e21b69713b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.615440] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bdb9acc-9f69-4cad-8ec2-80e21b69713b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.617336] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.617449] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.622240] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.622364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.627998] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.628145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.629249] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.629249] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.630538] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.630639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.631585] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.631585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.632542] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.632806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.634404] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.634604] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.635574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.635574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.636038] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.636592] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.636708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.637584] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.638066] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.638168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.638849] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.639326] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.642017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.642017] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.642017] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.642017] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.642017] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.642239] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.642280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.642931] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.643404] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.643516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.644746] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.645188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.645343] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee66d96e-b19b-40e4-b459-52eebc42250e is going to be deleted. [ 1299.646803] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.646935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.647074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.647303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.649310] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.649418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.676223] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.676223] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.676223] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a25ac3d-b904-4054-a34f-271c7b608728 is going to be deleted. [ 1299.677495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.677495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.701442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.701603] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 141d1a4a-af29-49fe-8321-94ad97de005a is going to be deleted. [ 1299.703019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.703019] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.727031] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.727031] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c19902d-3838-4141-b1c1-8a0050b66720 is going to be deleted. [ 1299.727571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.727816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.748409] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.748581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.751213] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.751213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.758332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.758546] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8bfd71e-0706-4e38-94f5-8c8814c273e6 is going to be deleted. [ 1299.759808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.760115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.782624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.782879] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44b9fe7e-d139-4b46-925d-7947b4b3dac9 is going to be deleted. [ 1299.784638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.784638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.787379] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.787379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.821954] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.822159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.822886] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.823034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.832204] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.832204] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789c0fa6-0949-4f7b-a35b-21a28f7a5386 is going to be deleted. [ 1299.833048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.833340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.867166] env[66854]: INFO networking_nsxv3.common.synchronization [None req-31e93d49-38f4-4fce-aeca-beb8c4d68579 tempest-AttachVolumeShelveTestJSON-1006044771 tempest-AttachVolumeShelveTestJSON-1006044771-project-member] Enqueued Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_rules [ 1299.868160] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_rules [ 1299.869034] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.869034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.869034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.869034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.869252] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.955062] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.955261] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.964500] env[66854]: INFO networking_nsxv3.common.synchronization [None req-3c1d18bb-ed4a-4bf8-82ab-4134833dd43c tempest-AttachVolumeShelveTestJSON-1006044771 tempest-AttachVolumeShelveTestJSON-1006044771-project-member] Enqueued Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_rules [ 1299.965679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.965998] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ccc5a4-8c8a-445b-b37a-462c691c3639 is going to be deleted. [ 1299.967370] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_rules [ 1299.967563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.967777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.969228] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.969336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.998276] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.998476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.010731] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.011055] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a491a51f-1883-4e2c-a822-89d817e590ca is going to be deleted. [ 1300.011929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.012182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.071276] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.095463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.095707] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 004af225-cfe6-418e-bf9b-b21fc4fcd911 is going to be deleted. [ 1300.096553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.096775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.112558] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.112747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.118638] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bdb9acc-9f69-4cad-8ec2-80e21b69713b [ 1300.118874] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.119011] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.119096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.119346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.119452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.120814] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bdb9acc-9f69-4cad-8ec2-80e21b69713b already deleted. [ 1300.120814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bdb9acc-9f69-4cad-8ec2-80e21b69713b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.129499] env[66854]: INFO networking_nsxv3.common.synchronization [req-ae06a685-4eb0-4bcd-b185-c83f5264ff1a req-1e8c5d06-e610-4326-a89b-249ffb5845b2 tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_members [ 1300.130202] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGHEST for action security_group_members [ 1300.130636] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-145b4f21-7695-4838-8836-f19d46e237a2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.130771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.130835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.131068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.131246] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.131357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.131418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.131599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.131688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.131786] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.149291] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.149490] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82708b01-13e8-453a-8492-93929a99b850 is going to be deleted. [ 1300.150307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.150527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.176564] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.176693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.226498] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.226710] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1466949f-e84c-4398-88b8-456cc5ec401b is going to be deleted. [ 1300.227713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.228321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.258742] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.258874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.280705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.281139] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2102370c-50ee-4712-bad2-1dc6ac49ebb5 is going to be deleted. [ 1300.282784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.284077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.310630] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.310630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.339327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.339478] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6779288d-3538-4416-9c3b-5f739846d8f3 is going to be deleted. [ 1300.340428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.340593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.399177] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.399389] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.417667] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.417864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.436088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.436088] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7025fd1c-e490-40e6-9db4-8ead9e399bb5 is going to be deleted. [ 1300.436620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.437287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.515995] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.516297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.531109] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.531332] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76446c38-ff50-4477-b278-800d793d9a4e is going to be deleted. [ 1300.532495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.532816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.535088] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.535308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.574529] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9e85364-8cd8-4a16-8f5e-17eb2478a9b7: rpc.has_security_group_logging(os_id): False [ 1300.585549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.585713] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f976c-9aad-49d6-90f2-cd04bf828754 is going to be deleted. [ 1300.586683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.586927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.614974] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.615144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.616935] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.616935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.621907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.622055] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f6d823-e856-4d40-8105-f4f2f0010d02 is going to be deleted. [ 1300.622964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.623323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.634152] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.634311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.703654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.703654] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1308feff-f29c-49ab-ba49-67f2be7bd392 is going to be deleted. [ 1300.704757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.704996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.705112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.705243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a25ac3d-b904-4054-a34f-271c7b608728" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.705408] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.705577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.705659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.705776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee66d96e-b19b-40e4-b459-52eebc42250e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.706337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.706507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.706590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.706712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-141d1a4a-af29-49fe-8321-94ad97de005a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.706865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.707025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.707106] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.707254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8bfd71e-0706-4e38-94f5-8c8814c273e6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.707393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.707539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.707617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.707735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c19902d-3838-4141-b1c1-8a0050b66720" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.707858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.707995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.708085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.708199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44b9fe7e-d139-4b46-925d-7947b4b3dac9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.708327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.708467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.708639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.708639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789c0fa6-0949-4f7b-a35b-21a28f7a5386" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.708905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.708905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.709033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.709110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ccc5a4-8c8a-445b-b37a-462c691c3639" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.709233] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.709372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.709447] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.709557] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a491a51f-1883-4e2c-a822-89d817e590ca" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.709743] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.709817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.709869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.709983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-004af225-cfe6-418e-bf9b-b21fc4fcd911" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.710131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.710272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.710345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.710457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82708b01-13e8-453a-8492-93929a99b850" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.710575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.710709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.710784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.710891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1466949f-e84c-4398-88b8-456cc5ec401b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.711029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.711210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.711288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.711391] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72bc065f-1602-44ca-b327-86db0c6cea37 already deleted. [ 1300.711472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.711602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.711742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.711816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.711923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6779288d-3538-4416-9c3b-5f739846d8f3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.712045] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.712185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.712273] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.713387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.713551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.713551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.713615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2102370c-50ee-4712-bad2-1dc6ac49ebb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.713962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.714613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.714613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.714613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7025fd1c-e490-40e6-9db4-8ead9e399bb5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.714613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.714613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.717174] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.717174] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.776113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.776113] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.776113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.776113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.776113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.776113] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.776113] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be updated. [ 1300.777080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.777283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.807790] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.807962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.810458] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.810575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.834673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.834961] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.835102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.835165] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.835325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.835409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.835571] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 145b4f21-7695-4838-8836-f19d46e237a2 is going to be updated. [ 1300.836547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.836732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.836821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.836947] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76446c38-ff50-4477-b278-800d793d9a4e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.837153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.837342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.837427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.837547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f976c-9aad-49d6-90f2-cd04bf828754" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.838134] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.838370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.838454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.838570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f6d823-e856-4d40-8105-f4f2f0010d02" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.897372] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.897372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.897372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.897372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.897815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.898155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1308feff-f29c-49ab-ba49-67f2be7bd392" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.940035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.940035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.940035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.940035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.940035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.948620] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.948775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.948850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.949076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.949219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.961422] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 145b4f21-7695-4838-8836-f19d46e237a2 in Status: IN_PROGRESS for 2s [ 1300.965518] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1300.965518] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1301.232125] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.232458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.232458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.232537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.232620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.232717] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72bc065f-1602-44ca-b327-86db0c6cea37 already deleted. [ 1301.232800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.887527] env[66854]: INFO networking_nsxv3.common.synchronization [None req-d7959a2e-d72d-44ea-b54a-331bc012dad0 None None] Enqueued Resource ID: 81cb87cc-7db1-483d-8410-a981501c18d8 with Priority: HIGHEST for action port [ 1301.887527] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cb87cc-7db1-483d-8410-a981501c18d8 with Priority: HIGHEST for action port [ 1301.888432] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-81cb87cc-7db1-483d-8410-a981501c18d8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.888552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81cb87cc-7db1-483d-8410-a981501c18d8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.888616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81cb87cc-7db1-483d-8410-a981501c18d8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.888877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81cb87cc-7db1-483d-8410-a981501c18d8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.888960] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81cb87cc-7db1-483d-8410-a981501c18d8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.391274] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81cb87cc-7db1-483d-8410-a981501c18d8 [ 1302.391685] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.391920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.391920] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.392127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.392229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.392332] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81cb87cc-7db1-483d-8410-a981501c18d8 already deleted. [ 1302.392419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81cb87cc-7db1-483d-8410-a981501c18d8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.973804] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 145b4f21-7695-4838-8836-f19d46e237a2 in Status: SUCCESS [ 1302.973989] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 145b4f21-7695-4838-8836-f19d46e237a2 deletion is rescheduled due to dependency. [ 1302.974135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.976059] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1302.976250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.547565] env[66854]: INFO networking_nsxv3.common.synchronization [None req-aeebfc99-aea7-4d05-8af2-021ced198429 tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_rules [ 1304.548144] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_rules [ 1304.548453] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7baf8ee-6396-451b-8325-2681f81448be taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.548576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.548645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.548895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.549123] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.632759] env[66854]: INFO networking_nsxv3.common.synchronization [None req-d394dbd5-2744-483a-971e-e4b93fab557d tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_rules [ 1304.633196] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_rules [ 1304.633513] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7baf8ee-6396-451b-8325-2681f81448be taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.633616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.069731] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.069892] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.069985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.070195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.070290] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.070412] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7baf8ee-6396-451b-8325-2681f81448be already deleted. [ 1305.070476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.070619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.070775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.070860] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.590922] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.591315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.591315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.591524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.591524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.591524] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7baf8ee-6396-451b-8325-2681f81448be already deleted. [ 1305.591624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.462703] env[66854]: INFO networking_nsxv3.common.synchronization [req-53afe171-d1b8-4727-a385-756b37b4ccd7 req-63763fd2-2241-4ff6-b66f-e666b47d33aa tempest-AttachVolumeShelveTestJSON-1006044771 tempest-AttachVolumeShelveTestJSON-1006044771-project-member] Enqueued Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_members [ 1306.462703] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_members [ 1306.462844] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.462967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.463049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.463452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.463626] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.463749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.463828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.463994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.464091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.464214] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.788883] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.789260] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.789260] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.789573] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.789833] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.789994] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.790311] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.790583] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.790735] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.790973] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1306.791108] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1306.791223] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1306.791338] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1306.791453] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1306.791566] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1306.791703] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1306.810378] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1306.810607] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1306.810683] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1306.810850] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.811193] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-aa8ca389-8a04-4ff6-b624-0bd421533a7b taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.811397] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.811525] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.811849] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.811994] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa8ca389-8a04-4ff6-b624-0bd421533a7b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.967121] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.967121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.967121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.967121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.967121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.967483] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.967483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.967483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.967610] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.967689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.967774] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72bc065f-1602-44ca-b327-86db0c6cea37 already deleted. [ 1306.967852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.315285] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.315554] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.315621] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.315909] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.316082] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.316237] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port aa8ca389-8a04-4ff6-b624-0bd421533a7b not found, creating... [ 1307.316539] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.316705] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.316824] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.317051] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.317195] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.317472] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.317626] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.317758] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.317961] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.318108] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.318248] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: aa8ca389-8a04-4ff6-b624-0bd421533a7b is going to be created. [ 1307.340061] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.340429] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.340554] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.340752] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.341026] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.341285] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.018416] env[66854]: INFO networking_nsxv3.common.synchronization [req-53afe171-d1b8-4727-a385-756b37b4ccd7 req-0a729224-ee48-4ee7-a430-183d5e761cf0 service nova] Enqueued Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_rules [ 1308.018736] env[66854]: INFO networking_nsxv3.common.synchronization [req-53afe171-d1b8-4727-a385-756b37b4ccd7 req-0a729224-ee48-4ee7-a430-183d5e761cf0 service nova] Enqueued Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_members [ 1308.018910] env[66854]: INFO networking_nsxv3.common.synchronization [req-53afe171-d1b8-4727-a385-756b37b4ccd7 req-0a729224-ee48-4ee7-a430-183d5e761cf0 service nova] Enqueued Resource ID: aa8ca389-8a04-4ff6-b624-0bd421533a7b with Priority: HIGHEST for action port [ 1308.019474] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_rules [ 1308.019614] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_members [ 1308.019708] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8ca389-8a04-4ff6-b624-0bd421533a7b with Priority: HIGHEST for action port [ 1308.019978] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.020110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.020177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.020370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.020468] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.021304] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.021402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.021470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.021660] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.021811] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.021906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.021995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.023183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.023303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.023403] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.024537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa8ca389-8a04-4ff6-b624-0bd421533a7b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.024745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.024832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.024999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.025088] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa8ca389-8a04-4ff6-b624-0bd421533a7b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.527400] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.528549] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.528661] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.528841] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa8ca389-8a04-4ff6-b624-0bd421533a7b with status ACTIVE [ 1308.528990] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.529115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.529178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.530911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.530911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.530911] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.530911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.530911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.530911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.530911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.530911] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.530911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.530911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.530911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.530911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.530911] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa8ca389-8a04-4ff6-b624-0bd421533a7b is going to be updated. [ 1308.551673] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.551817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.551888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.552109] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.552255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.552400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.032615] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.535499] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.535723] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.535767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.535985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.536083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.536185] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72bc065f-1602-44ca-b327-86db0c6cea37 is going to be created. [ 1309.558681] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.558893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.558893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.559116] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.559276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.568516] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72bc065f-1602-44ca-b327-86db0c6cea37 in Status: UNINITIALIZED for 2s [ 1311.580186] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72bc065f-1602-44ca-b327-86db0c6cea37 in Status: SUCCESS [ 1311.580545] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.580669] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.580987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.581215] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.581348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.581473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.581668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.581768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.581883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.582066] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.084631] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.209054] env[66854]: INFO networking_nsxv3.common.synchronization [req-60e3ecda-af6e-4871-a0d3-cfc720423f9c req-227990e9-7800-461c-95fc-a2cbd2d64f3e tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_members [ 1312.209192] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_members [ 1312.209377] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7baf8ee-6396-451b-8325-2681f81448be taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.209525] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.209595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.209851] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.210050] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.210186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.210251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.210410] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.210494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.210588] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.507438] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.507637] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.507762] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.508032] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.508295] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.508454] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.508569] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.508778] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.508918] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.509139] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1312.509287] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1312.509404] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1312.509517] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1312.509626] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1312.509730] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1312.509861] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1312.528289] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1312.528465] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1312.528588] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1312.528766] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.529090] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-a8f255a4-b322-4748-a26e-7081929765bf taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.529263] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-a8f255a4-b322-4748-a26e-7081929765bf" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.529380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-a8f255a4-b322-4748-a26e-7081929765bf" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.529711] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-a8f255a4-b322-4748-a26e-7081929765bf" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.529854] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f255a4-b322-4748-a26e-7081929765bf',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.587577] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72bc065f-1602-44ca-b327-86db0c6cea37: rpc.has_security_group_logging(os_id): False [ 1312.606343] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.606571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.606571] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.606755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.606844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.607099] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.607200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.607264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.607417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.607494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.607580] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72bc065f-1602-44ca-b327-86db0c6cea37 is going to be created. [ 1312.673506] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.673737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.673737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.673882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.674081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.688359] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72bc065f-1602-44ca-b327-86db0c6cea37 in Status: IN_PROGRESS for 2s [ 1312.713076] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.713307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.713451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.713713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.713817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.714076] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.714203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.714280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.714477] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.714566] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.714655] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7baf8ee-6396-451b-8325-2681f81448be already deleted. [ 1312.714740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.032776] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.033022] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.033154] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.033520] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.033671] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.033822] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port a8f255a4-b322-4748-a26e-7081929765bf not found, creating... [ 1313.034093] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.034250] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.034482] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.034709] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.034846] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.035146] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.035305] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.035423] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.035635] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.035785] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.035924] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: a8f255a4-b322-4748-a26e-7081929765bf is going to be created. [ 1313.058341] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.058576] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.058680] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.059154] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.059549] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.059915] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-a8f255a4-b322-4748-a26e-7081929765bf" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.772264] env[66854]: INFO networking_nsxv3.common.synchronization [req-60e3ecda-af6e-4871-a0d3-cfc720423f9c req-57083f8e-cf8c-42f0-8f3c-f3cc4d8ea10c service nova] Enqueued Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_rules [ 1313.772505] env[66854]: INFO networking_nsxv3.common.synchronization [req-60e3ecda-af6e-4871-a0d3-cfc720423f9c req-57083f8e-cf8c-42f0-8f3c-f3cc4d8ea10c service nova] Enqueued Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_members [ 1313.772634] env[66854]: INFO networking_nsxv3.common.synchronization [req-60e3ecda-af6e-4871-a0d3-cfc720423f9c req-57083f8e-cf8c-42f0-8f3c-f3cc4d8ea10c service nova] Enqueued Resource ID: a8f255a4-b322-4748-a26e-7081929765bf with Priority: HIGHEST for action port [ 1313.773175] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_rules [ 1313.773370] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_members [ 1313.773507] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8f255a4-b322-4748-a26e-7081929765bf with Priority: HIGHEST for action port [ 1313.773848] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7baf8ee-6396-451b-8325-2681f81448be taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.773948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.774036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.774250] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.774381] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.776788] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7baf8ee-6396-451b-8325-2681f81448be taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.776916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.777026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.777219] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.777371] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.777656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.777656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.777656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.777742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.777819] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.778538] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8f255a4-b322-4748-a26e-7081929765bf taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.778656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8f255a4-b322-4748-a26e-7081929765bf" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.778716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8f255a4-b322-4748-a26e-7081929765bf" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.779615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8f255a4-b322-4748-a26e-7081929765bf" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.779615] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f255a4-b322-4748-a26e-7081929765bf',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.280488] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.281666] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7baf8ee-6396-451b-8325-2681f81448be taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.281916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.282280] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8f255a4-b322-4748-a26e-7081929765bf with status ACTIVE [ 1314.282509] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.282678] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.282793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.283105] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.283245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.283484] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.283635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.283742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.283962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.284229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.284388] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.284542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.284689] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.284866] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.285039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.285144] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8f255a4-b322-4748-a26e-7081929765bf is going to be updated. [ 1314.307436] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.307574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.307638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.307889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.308054] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.308217] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8f255a4-b322-4748-a26e-7081929765bf" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.700960] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72bc065f-1602-44ca-b327-86db0c6cea37 in Status: SUCCESS [ 1314.701195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.782862] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.285306] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.285524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.285524] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.285806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.285896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.286027] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7baf8ee-6396-451b-8325-2681f81448be is going to be created. [ 1315.313744] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.313933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.313933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.314181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.314358] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.323775] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7baf8ee-6396-451b-8325-2681f81448be in Status: UNINITIALIZED for 2s [ 1317.337864] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7baf8ee-6396-451b-8325-2681f81448be in Status: SUCCESS [ 1317.338260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.338260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.338445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.338724] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.338941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.339086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.339352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.339455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.339563] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.339667] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.842835] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.345982] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7baf8ee-6396-451b-8325-2681f81448be: rpc.has_security_group_logging(os_id): False [ 1318.367635] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.367861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.367905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.368255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.368346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.368637] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.368763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.368830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.369038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.369149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.369285] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7baf8ee-6396-451b-8325-2681f81448be is going to be created. [ 1318.430038] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.430277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.430387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.430709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.430979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.442050] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7baf8ee-6396-451b-8325-2681f81448be in Status: IN_PROGRESS for 2s [ 1318.774966] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.775185] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1320.457563] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7baf8ee-6396-451b-8325-2681f81448be in Status: SUCCESS [ 1320.457912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.776323] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.776730] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1328.778303] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.778303] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.781389] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.781682] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.987913] env[66854]: INFO networking_nsxv3.common.synchronization [req-5c7c68b7-4718-44c8-9620-d4d41bbbdb1a req-c198b079-a830-4bf5-a24b-36517b78926a tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1333.987913] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1333.987913] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.987913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.987913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.988496] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.988688] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.988844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.988949] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.989178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.989294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.989410] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.492194] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.492412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.492412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.492584] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.492676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.492888] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.492993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.493071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.493419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.493419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.493419] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be updated. [ 1334.520858] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.521097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.521097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.521298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.521437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.531623] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1336.542835] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1336.543236] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 deletion is rescheduled due to dependency. [ 1336.543236] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.988381] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.988757] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.058154] env[66854]: INFO networking_nsxv3.common.synchronization [req-aa6a5e9c-19ed-40fa-aa93-2bdd91fb2a5c req-20e93ac5-35f0-4700-b322-abad33a029d2 tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1341.058651] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1341.059017] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.059611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.059702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.059946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.060164] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.060287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.060380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.060567] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.060675] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.060776] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.321181] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.321439] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.321599] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.321913] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.322299] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.322412] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.322533] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.322750] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.322904] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.323148] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1341.323276] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1341.323658] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1341.323658] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1341.323658] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1341.323751] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1341.323807] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1341.346133] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1341.346133] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1341.346133] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1341.346459] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.346603] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-027a20ca-1814-45d7-9f75-d50fe678e0ac taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.346764] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-027a20ca-1814-45d7-9f75-d50fe678e0ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.346906] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-027a20ca-1814-45d7-9f75-d50fe678e0ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.347248] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-027a20ca-1814-45d7-9f75-d50fe678e0ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.347653] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('027a20ca-1814-45d7-9f75-d50fe678e0ac',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.562857] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.563097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.563097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.563345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.563444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.563651] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.563753] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.563836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.564082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.564135] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.564203] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be updated. [ 1341.592293] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.592485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.592485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.592677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.592817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.602248] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1341.849671] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.849925] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.850035] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.850376] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.850533] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.850688] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 027a20ca-1814-45d7-9f75-d50fe678e0ac not found, creating... [ 1341.850952] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.851124] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.851241] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.851476] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.851607] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.852158] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.852158] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.852296] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.852469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.852607] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.852747] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 027a20ca-1814-45d7-9f75-d50fe678e0ac is going to be created. [ 1341.875862] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.876167] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.876305] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.876514] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.876746] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.876969] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-027a20ca-1814-45d7-9f75-d50fe678e0ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.563494] env[66854]: INFO networking_nsxv3.common.synchronization [req-aa6a5e9c-19ed-40fa-aa93-2bdd91fb2a5c req-e9902083-9704-483c-a584-0a3e5513ae60 service nova] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_rules [ 1342.563788] env[66854]: INFO networking_nsxv3.common.synchronization [req-aa6a5e9c-19ed-40fa-aa93-2bdd91fb2a5c req-e9902083-9704-483c-a584-0a3e5513ae60 service nova] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1342.563880] env[66854]: INFO networking_nsxv3.common.synchronization [req-aa6a5e9c-19ed-40fa-aa93-2bdd91fb2a5c req-e9902083-9704-483c-a584-0a3e5513ae60 service nova] Enqueued Resource ID: 027a20ca-1814-45d7-9f75-d50fe678e0ac with Priority: HIGHEST for action port [ 1342.564393] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_rules [ 1342.564532] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1342.564631] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 027a20ca-1814-45d7-9f75-d50fe678e0ac with Priority: HIGHEST for action port [ 1342.564920] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.565064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.565156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.565328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.565413] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.566517] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.566616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.566810] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-027a20ca-1814-45d7-9f75-d50fe678e0ac taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.566911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-027a20ca-1814-45d7-9f75-d50fe678e0ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.566978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-027a20ca-1814-45d7-9f75-d50fe678e0ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.567175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-027a20ca-1814-45d7-9f75-d50fe678e0ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.567255] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('027a20ca-1814-45d7-9f75-d50fe678e0ac',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.069646] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.069960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.069960] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 027a20ca-1814-45d7-9f75-d50fe678e0ac with status ACTIVE [ 1343.070109] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.070234] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.070285] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.070523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.070693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.070873] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.070980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.071059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.071231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.071313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.071498] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.071612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.071677] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.071821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.071897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.071988] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 027a20ca-1814-45d7-9f75-d50fe678e0ac is going to be updated. [ 1343.092833] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.093068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.093068] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.093253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.093397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.093551] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-027a20ca-1814-45d7-9f75-d50fe678e0ac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.612860] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1343.612860] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 deletion is rescheduled due to dependency. [ 1343.612860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.613377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.613597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.613786] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.613913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.613994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.614168] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.614248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.614342] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.116832] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.618888] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.121551] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.121739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.121793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.122014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.122118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.122223] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be updated. [ 1345.152387] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.152605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.152605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.152793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.152935] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.161940] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1347.174121] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1347.174121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.174121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.174121] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.174560] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.174560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.174560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.174728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.174728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.174790] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.174951] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.565487] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.565762] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1347.677352] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.180446] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9e85364-8cd8-4a16-8f5e-17eb2478a9b7: rpc.has_security_group_logging(os_id): False [ 1348.198551] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.198766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.198766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.198966] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.199074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.199324] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.199428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.199494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.199650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.199729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.199821] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be updated. [ 1348.263323] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.263518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.263518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.263735] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.263888] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.276755] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1350.291699] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1350.291699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.566281] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1352.566639] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.567426] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.567875] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1362.568713] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.569176] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1362.886051] env[66854]: INFO networking_nsxv3.common.synchronization [req-abe46679-feac-4f61-bfaa-dba3b85336cc req-e246390a-5bb6-4465-9eb3-1d6ef5dd1c21 tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_members [ 1362.886722] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGHEST for action security_group_members [ 1362.887111] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7baf8ee-6396-451b-8325-2681f81448be taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.887906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.887906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.887906] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.888049] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.888142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.888203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.888336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.888462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.888794] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.391078] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.391349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.391349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.391612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.391868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.392161] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.392363] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.392417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.392604] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.392727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.392831] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7baf8ee-6396-451b-8325-2681f81448be is going to be updated. [ 1363.423359] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.423582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.423582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.423867] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.424036] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.432573] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7baf8ee-6396-451b-8325-2681f81448be in Status: IN_PROGRESS for 2s [ 1365.442618] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7baf8ee-6396-451b-8325-2681f81448be in Status: SUCCESS [ 1365.443025] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7baf8ee-6396-451b-8325-2681f81448be deletion is rescheduled due to dependency. [ 1365.443025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.887848] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.888258] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.889275] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.889782] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.217968] env[66854]: INFO networking_nsxv3.common.synchronization [req-b4817d41-de51-4152-a4ae-d0df0779aa38 req-37431ad4-9eeb-4bff-8119-8141994b9154 tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_members [ 1374.217968] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGHEST for action security_group_members [ 1374.218437] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c77425c2-9b5e-4d53-92ee-45328ba247f6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.218700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.218866] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.219244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.219509] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.219744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.219927] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.220195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.220406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.220609] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.722819] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.723039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.723095] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.723298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.746039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.746309] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.746430] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.746498] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.746702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.746786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.746877] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 is going to be updated. [ 1374.775427] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.775604] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.775649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.775856] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.776014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.785112] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 in Status: IN_PROGRESS for 2s [ 1376.795547] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 in Status: SUCCESS [ 1376.795953] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 deletion is rescheduled due to dependency. [ 1376.795953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.006342] env[66854]: INFO networking_nsxv3.common.synchronization [None req-883a91b3-9cbb-4b5d-8ace-c04c27ff942c tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_rules [ 1379.007715] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_rules [ 1379.007715] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.007715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.007715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.008201] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.008201] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.092326] env[66854]: INFO networking_nsxv3.common.synchronization [None req-6a942bcb-9d24-467a-a642-4a6e5ac0614e tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_rules [ 1379.093025] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_rules [ 1379.093559] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.093700] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.531453] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.531643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.531690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.531873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.532112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.532218] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa already deleted. [ 1379.532310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.532461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.532658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.532884] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.055378] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.055789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.055789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.055904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.056015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.056118] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa already deleted. [ 1380.056267] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.094392] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.094739] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.459322] env[66854]: INFO networking_nsxv3.common.synchronization [req-13a47bdb-ce3f-4dcc-81ea-5791a5874f63 req-3cfabad7-e0fa-42c1-9ab2-b5752bb604ed tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_members [ 1384.459966] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_members [ 1384.460254] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c3cde5-4f79-4bce-8884-f82cd352d6aa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.460377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.460448] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.460713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.460887] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.460988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.461062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.461238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.461322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.461419] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.738771] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.738988] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.739109] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.739469] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.739743] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.739906] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.740042] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.740268] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.740413] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.740622] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1384.740735] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1384.740844] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1384.740951] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1384.741075] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1384.741186] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1384.741319] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1384.761844] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1384.762014] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1384.762160] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1384.762334] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.762635] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-b0736d32-b679-4944-96c8-5c00caf0fa23 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.762794] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-b0736d32-b679-4944-96c8-5c00caf0fa23" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.762924] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-b0736d32-b679-4944-96c8-5c00caf0fa23" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.763300] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-b0736d32-b679-4944-96c8-5c00caf0fa23" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.763448] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0736d32-b679-4944-96c8-5c00caf0fa23',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.967537] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.967758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.967758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.967971] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.968078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.968289] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.968387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.968451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.968599] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.968674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.968760] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa already deleted. [ 1384.968838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.266050] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.266412] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.266412] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.266811] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.266811] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.266973] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port b0736d32-b679-4944-96c8-5c00caf0fa23 not found, creating... [ 1385.267253] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.267412] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.267529] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.267749] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.267878] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.268179] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.268332] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.268448] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.268733] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.268798] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.268916] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: b0736d32-b679-4944-96c8-5c00caf0fa23 is going to be created. [ 1385.288787] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.288982] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.289144] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.289378] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.289601] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.289821] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-b0736d32-b679-4944-96c8-5c00caf0fa23" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.986462] env[66854]: INFO networking_nsxv3.common.synchronization [req-13a47bdb-ce3f-4dcc-81ea-5791a5874f63 req-28585671-a09d-4403-9090-6219f07e7df6 service nova] Enqueued Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_rules [ 1385.986729] env[66854]: INFO networking_nsxv3.common.synchronization [req-13a47bdb-ce3f-4dcc-81ea-5791a5874f63 req-28585671-a09d-4403-9090-6219f07e7df6 service nova] Enqueued Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_members [ 1385.986859] env[66854]: INFO networking_nsxv3.common.synchronization [req-13a47bdb-ce3f-4dcc-81ea-5791a5874f63 req-28585671-a09d-4403-9090-6219f07e7df6 service nova] Enqueued Resource ID: b0736d32-b679-4944-96c8-5c00caf0fa23 with Priority: HIGHEST for action port [ 1385.987365] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_rules [ 1385.987569] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_members [ 1385.987634] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0736d32-b679-4944-96c8-5c00caf0fa23 with Priority: HIGHEST for action port [ 1385.987928] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.988211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.988211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.988356] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.988423] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.989353] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c3cde5-4f79-4bce-8884-f82cd352d6aa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.989453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.989523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.989710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.989862] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.989977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.990072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.990180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.990266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.990357] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.991125] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0736d32-b679-4944-96c8-5c00caf0fa23 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.991246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0736d32-b679-4944-96c8-5c00caf0fa23" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.991311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0736d32-b679-4944-96c8-5c00caf0fa23" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.991510] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0736d32-b679-4944-96c8-5c00caf0fa23" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.991510] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0736d32-b679-4944-96c8-5c00caf0fa23',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.493337] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.494574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c3cde5-4f79-4bce-8884-f82cd352d6aa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.494736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.495503] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0736d32-b679-4944-96c8-5c00caf0fa23 with status ACTIVE [ 1386.495503] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.495503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.495503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.495503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.495784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.495784] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.495860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.495893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.496050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.496145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.496356] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.496473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.496538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.496742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.496864] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.496962] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0736d32-b679-4944-96c8-5c00caf0fa23 is going to be updated. [ 1386.518266] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.518432] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.518483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.518681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.518824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.518986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0736d32-b679-4944-96c8-5c00caf0fa23" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.998776] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.100387] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.100586] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.100711] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.101085] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.101505] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.101505] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.101641] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.101823] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.102022] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.102183] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1387.102299] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1387.102402] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1387.102507] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1387.102615] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1387.102720] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1387.102851] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1387.121508] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1387.121678] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1387.121814] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1387.121979] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.122314] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-aa8ca389-8a04-4ff6-b624-0bd421533a7b taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.122486] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.122600] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.122848] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.122992] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa8ca389-8a04-4ff6-b624-0bd421533a7b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.501035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.501385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.501385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.501512] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.501570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.501674] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa is going to be created. [ 1387.526027] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.526229] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.526284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.526469] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.526629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.535413] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa in Status: UNINITIALIZED for 2s [ 1387.626688] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.626920] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.627251] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.627390] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.627507] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.627793] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.627947] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.628082] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.628410] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.628646] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.628936] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.629110] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.629230] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.629451] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.629586] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.629725] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: aa8ca389-8a04-4ff6-b624-0bd421533a7b is going to be updated. [ 1387.674121] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.674357] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.674460] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.674755] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.674945] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.675271] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.350422] env[66854]: INFO networking_nsxv3.common.synchronization [req-577680c5-b6f8-4367-9357-bd336c3a17a2 req-c56b5fe6-7a1a-4567-913c-0bc01161a89b service nova] Enqueued Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_rules [ 1388.350622] env[66854]: INFO networking_nsxv3.common.synchronization [req-577680c5-b6f8-4367-9357-bd336c3a17a2 req-c56b5fe6-7a1a-4567-913c-0bc01161a89b service nova] Enqueued Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_members [ 1388.350763] env[66854]: INFO networking_nsxv3.common.synchronization [req-577680c5-b6f8-4367-9357-bd336c3a17a2 req-c56b5fe6-7a1a-4567-913c-0bc01161a89b service nova] Enqueued Resource ID: aa8ca389-8a04-4ff6-b624-0bd421533a7b with Priority: HIGHEST for action port [ 1388.351292] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_rules [ 1388.351432] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_members [ 1388.351530] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8ca389-8a04-4ff6-b624-0bd421533a7b with Priority: HIGHEST for action port [ 1388.351803] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.351928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.351996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.352212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.352291] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.353613] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.353732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.353802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.353981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.354169] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.354245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.354302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.354446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.354533] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.354636] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.355553] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa8ca389-8a04-4ff6-b624-0bd421533a7b taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.355666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.355758] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.355916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.355994] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa8ca389-8a04-4ff6-b624-0bd421533a7b',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.858115] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.858115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.858441] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.859309] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa8ca389-8a04-4ff6-b624-0bd421533a7b with status ACTIVE [ 1388.859503] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.859616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.859746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.859891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.859979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.860169] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.860302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.860360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.861029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.861029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.861029] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.861029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.861029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.861029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.861327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.861327] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa8ca389-8a04-4ff6-b624-0bd421533a7b is going to be updated. [ 1388.882282] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.882494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.882494] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.882680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.882826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.882980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa8ca389-8a04-4ff6-b624-0bd421533a7b" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.363446] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.544720] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa in Status: SUCCESS [ 1389.544939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.545125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.545418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.545615] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.545729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.545796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.545944] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.546038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.546125] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.546237] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.865983] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.866321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.866321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.866450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.866547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.866648] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72bc065f-1602-44ca-b327-86db0c6cea37 is going to be updated. [ 1389.894815] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.895022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.895022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.895304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.895465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.905334] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72bc065f-1602-44ca-b327-86db0c6cea37 in Status: IN_PROGRESS for 2s [ 1390.048997] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.551248] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99c3cde5-4f79-4bce-8884-f82cd352d6aa: rpc.has_security_group_logging(os_id): False [ 1390.569185] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.569349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.569399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.569600] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.569693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.569930] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.570042] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.570117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.570263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.570339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.570425] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa is going to be created. [ 1390.628507] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.628656] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.628728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.628929] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.629128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.642858] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa in Status: IN_PROGRESS for 2s [ 1391.914885] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72bc065f-1602-44ca-b327-86db0c6cea37 in Status: SUCCESS [ 1391.915194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.915365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.915552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.915752] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.915871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.915940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.916106] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.916189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.916299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.916421] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.418531] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.657488] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa in Status: SUCCESS [ 1392.658199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.921355] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72bc065f-1602-44ca-b327-86db0c6cea37: rpc.has_security_group_logging(os_id): False [ 1392.940807] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.941086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.941086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.941251] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.941345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.941596] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.941719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.941785] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.941963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.942088] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.942197] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72bc065f-1602-44ca-b327-86db0c6cea37 is going to be updated. [ 1393.011851] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.012076] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.012123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.012342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.012493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.028247] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72bc065f-1602-44ca-b327-86db0c6cea37 in Status: IN_PROGRESS for 2s [ 1393.352862] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.352862] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1395.043309] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72bc065f-1602-44ca-b327-86db0c6cea37 in Status: SUCCESS [ 1395.043709] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.353615] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.353973] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.354835] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.355179] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.356164] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.356546] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.357321] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.357741] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.358557] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.358557] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.273160] env[66854]: INFO networking_nsxv3.common.synchronization [req-abe0380c-ca93-4401-ac07-455a40e7bade req-a37351c0-1b1a-4606-87c3-e59549e3d15b tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1421.273963] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1421.274657] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.274657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.274657] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.274834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.274834] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.275200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.275200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.275200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.275400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.275400] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.777543] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.777543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.777543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.777823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.777823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.777894] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.778015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.778078] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.778231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.778308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.778401] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be updated. [ 1421.806323] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.806323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.806323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.806590] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.806625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.815650] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1423.826071] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1423.826553] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 deletion is rescheduled due to dependency. [ 1423.826553] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.274910] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.275213] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.265842] env[66854]: INFO networking_nsxv3.common.synchronization [req-cdfe3048-980e-428d-b533-3cefde2df69a req-e1d9ed5f-5d86-4871-9d53-f18b8a491bd7 tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1430.266567] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1430.267062] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.267211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.267279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.267475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.267636] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.267738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.267797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.267951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.268050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.268163] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.574557] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.574793] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.574918] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.575215] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.575488] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.575648] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.575764] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.576040] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.576188] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.576416] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1430.576515] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1430.576686] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1430.576805] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1430.576927] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1430.577031] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1430.577165] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1430.599927] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1430.600115] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1430.600240] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1430.600407] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-606" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.600708] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-98ea34ed-3d04-4e52-938e-1b3d502067fe taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.600877] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-98ea34ed-3d04-4e52-938e-1b3d502067fe" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.600999] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-98ea34ed-3d04-4e52-938e-1b3d502067fe" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.601337] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-98ea34ed-3d04-4e52-938e-1b3d502067fe" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.601476] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98ea34ed-3d04-4e52-938e-1b3d502067fe',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.770973] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.771202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.771202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.771370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.771460] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.771655] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.771752] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.771815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.771963] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.772050] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.772138] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be updated. [ 1430.801844] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.802059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.802059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.802259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.802398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.811345] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1431.103347] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.103580] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.103710] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.104013] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.104165] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.104321] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 98ea34ed-3d04-4e52-938e-1b3d502067fe not found, creating... [ 1431.104611] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.104802] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.104922] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.105167] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.105299] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.105576] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.105814] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.105985] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.106198] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.106527] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.106527] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 98ea34ed-3d04-4e52-938e-1b3d502067fe is going to be created. [ 1431.128596] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.128812] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.128974] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.129287] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.129543] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.129783] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-98ea34ed-3d04-4e52-938e-1b3d502067fe" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.814783] env[66854]: INFO networking_nsxv3.common.synchronization [req-cdfe3048-980e-428d-b533-3cefde2df69a req-97ef9a96-a035-4b79-a0dc-1a1a99b2582e service nova] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_rules [ 1431.815087] env[66854]: INFO networking_nsxv3.common.synchronization [req-cdfe3048-980e-428d-b533-3cefde2df69a req-97ef9a96-a035-4b79-a0dc-1a1a99b2582e service nova] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1431.815155] env[66854]: INFO networking_nsxv3.common.synchronization [req-cdfe3048-980e-428d-b533-3cefde2df69a req-97ef9a96-a035-4b79-a0dc-1a1a99b2582e service nova] Enqueued Resource ID: 98ea34ed-3d04-4e52-938e-1b3d502067fe with Priority: HIGHEST for action port [ 1431.815662] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_rules [ 1431.815800] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1431.815898] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ea34ed-3d04-4e52-938e-1b3d502067fe with Priority: HIGHEST for action port [ 1431.816181] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.816319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.816365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.816558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.816671] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.817489] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.817628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.817784] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-98ea34ed-3d04-4e52-938e-1b3d502067fe taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.817891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98ea34ed-3d04-4e52-938e-1b3d502067fe" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.817953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98ea34ed-3d04-4e52-938e-1b3d502067fe" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.818136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98ea34ed-3d04-4e52-938e-1b3d502067fe" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.818213] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98ea34ed-3d04-4e52-938e-1b3d502067fe',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.320369] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.320515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.320754] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98ea34ed-3d04-4e52-938e-1b3d502067fe with status ACTIVE [ 1432.320951] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.321064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.321133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.321344] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.321437] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.321600] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.323025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.323025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.323025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.323025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.323025] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.323025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.323025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.323025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.323025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.323025] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98ea34ed-3d04-4e52-938e-1b3d502067fe is going to be updated. [ 1432.344687] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.344937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.344937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.345136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.345280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.345441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98ea34ed-3d04-4e52-938e-1b3d502067fe" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.821944] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1432.822359] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 deletion is rescheduled due to dependency. [ 1432.822359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.822359] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.822538] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.822719] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.822833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.822898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.823060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.823140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.823237] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.325514] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.828422] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.331172] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.331479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.331581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.331871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.331968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.332110] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be updated. [ 1434.361783] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.361951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.361995] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.362215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.362361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.371143] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1436.382485] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1436.383047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.383047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.383185] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.383368] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.383500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.383581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.383746] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.383826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.383913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.384014] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.817298] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.817497] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1436.886359] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.388610] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9e85364-8cd8-4a16-8f5e-17eb2478a9b7: rpc.has_security_group_logging(os_id): False [ 1437.406383] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.406679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.406679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.406815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.406883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.407186] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.407316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.407379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.407506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.407579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.407668] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be updated. [ 1437.473197] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.473472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.473472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.473608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.473694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.509873] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1439.526558] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1439.526905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.818892] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.819326] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.820193] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.820651] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.259228] env[66854]: INFO networking_nsxv3.common.synchronization [req-b8633a16-30c5-4eef-895b-23a7dd50ee34 req-e69344f5-3884-444d-a333-5e9a24e4654c tempest-AttachVolumeShelveTestJSON-1006044771 tempest-AttachVolumeShelveTestJSON-1006044771-project-member] Enqueued Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_members [ 1448.259872] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGHEST for action security_group_members [ 1448.260286] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.260439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.260505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.260693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.260855] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.260976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.261079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.261258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.261348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.261448] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.764345] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.764588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.764588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.765112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.765112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.765112] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.765365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.765365] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.765426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.765621] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.765621] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72bc065f-1602-44ca-b327-86db0c6cea37 is going to be updated. [ 1448.797267] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.797636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.797636] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.797761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.797849] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.806368] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72bc065f-1602-44ca-b327-86db0c6cea37 in Status: IN_PROGRESS for 2s [ 1449.844768] env[66854]: INFO networking_nsxv3.common.synchronization [req-5f89917a-3cbb-43c3-9cee-60a4f4525200 req-6284e046-1aec-4a5f-9ebf-4005b2364c1f tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_members [ 1449.845326] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGHEST for action security_group_members [ 1449.845670] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c3cde5-4f79-4bce-8884-f82cd352d6aa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.845799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.845868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.846077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.846231] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.846327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.846390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.846547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.846632] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.846723] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.348567] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.348784] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.348865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.349112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.349208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.349411] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.349506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.349568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.349716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.349791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.349877] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa is going to be updated. [ 1450.379401] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.379597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.379666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.379932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.380140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.388839] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa in Status: IN_PROGRESS for 2s [ 1450.818208] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72bc065f-1602-44ca-b327-86db0c6cea37 in Status: SUCCESS [ 1450.818390] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72bc065f-1602-44ca-b327-86db0c6cea37 deletion is rescheduled due to dependency. [ 1450.818515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.401518] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa in Status: SUCCESS [ 1452.401846] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa deletion is rescheduled due to dependency. [ 1452.401846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.962640] env[66854]: INFO networking_nsxv3.common.synchronization [None req-44c834ec-f1f7-477e-86fb-5085f3f2f23f tempest-AttachVolumeShelveTestJSON-1006044771 tempest-AttachVolumeShelveTestJSON-1006044771-project-member] Enqueued Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_rules [ 1452.963569] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_rules [ 1452.963891] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.964035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.964151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.964355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.964475] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.044826] env[66854]: INFO networking_nsxv3.common.synchronization [None req-8c030c5b-0a8a-4c5b-aebf-ea76ebe882c5 tempest-AttachVolumeShelveTestJSON-1006044771 tempest-AttachVolumeShelveTestJSON-1006044771-project-member] Enqueued Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_rules [ 1453.045482] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_rules [ 1453.045759] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.045868] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.485427] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.485692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.485777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.485998] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.486117] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.487029] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 already deleted. [ 1453.487029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.487029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.487029] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.487236] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.002030] env[66854]: INFO networking_nsxv3.common.synchronization [None req-19946195-a684-47a0-a998-65055002e4bd tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_rules [ 1454.002030] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_rules [ 1454.002182] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67896546-87c2-482e-8efd-5544fae75f04 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.002246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.002283] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.003041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.003041] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.009416] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.009619] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.009749] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.009912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.010023] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.010124] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 already deleted. [ 1454.010207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.087154] env[66854]: INFO networking_nsxv3.common.synchronization [None req-bbc933d3-7b3e-4cfa-91cd-0864686b79e5 tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_rules [ 1454.087878] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_rules [ 1454.088441] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67896546-87c2-482e-8efd-5544fae75f04 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.088623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.529949] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.530327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.530327] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.530596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.530596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.530682] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67896546-87c2-482e-8efd-5544fae75f04 already deleted. [ 1454.530716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.531255] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.531427] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.531515] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.056358] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.056560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.056605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.056897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.056999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.057115] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67896546-87c2-482e-8efd-5544fae75f04 already deleted. [ 1455.057202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.404472] env[66854]: INFO networking_nsxv3.common.synchronization [req-0b0d247f-b38f-4e5d-a631-6c7e471eab3c req-5b2673f5-c6e3-40d9-9747-ab2a5ab74570 tempest-AttachVolumeShelveTestJSON-1006044771 tempest-AttachVolumeShelveTestJSON-1006044771-project-member] Enqueued Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_members [ 1458.404967] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_members [ 1458.405325] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.405454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.405522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.405800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.406051] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.406124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.406199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.406336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.406454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.406561] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.721650] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.721916] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.722074] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.722322] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.722571] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.722733] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.722847] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.723076] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.723217] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.723433] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1458.723545] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1458.723653] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1458.723760] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1458.723869] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1458.724008] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1458.724170] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1458.746488] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1458.746681] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1458.746820] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1458.747051] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.747402] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.747606] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.747886] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.748302] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.748528] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cde72b4f-04ad-4891-89b0-0ff5c6f7f69d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.910029] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.910264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.910264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.910425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.910517] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.910724] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.910823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.910884] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.911049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.911127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.911211] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 already deleted. [ 1458.911288] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.250671] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.250868] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.251029] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.251354] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.251565] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.251757] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port cde72b4f-04ad-4891-89b0-0ff5c6f7f69d not found, creating... [ 1459.252067] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.252237] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.252354] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.252578] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.252715] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.252989] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.253202] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.253317] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.253524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.253668] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.253816] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: cde72b4f-04ad-4891-89b0-0ff5c6f7f69d is going to be created. [ 1459.274490] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.274728] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.274817] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.275089] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.275360] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.275625] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.979147] env[66854]: INFO networking_nsxv3.common.synchronization [req-0b0d247f-b38f-4e5d-a631-6c7e471eab3c req-a6a036d3-cc36-4d50-b76d-f6700e664b4f service nova] Enqueued Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_rules [ 1459.979406] env[66854]: INFO networking_nsxv3.common.synchronization [req-0b0d247f-b38f-4e5d-a631-6c7e471eab3c req-a6a036d3-cc36-4d50-b76d-f6700e664b4f service nova] Enqueued Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_members [ 1459.979945] env[66854]: INFO networking_nsxv3.common.synchronization [req-0b0d247f-b38f-4e5d-a631-6c7e471eab3c req-a6a036d3-cc36-4d50-b76d-f6700e664b4f service nova] Enqueued Resource ID: cde72b4f-04ad-4891-89b0-0ff5c6f7f69d with Priority: HIGHEST for action port [ 1459.980469] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_rules [ 1459.980607] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_members [ 1459.980705] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cde72b4f-04ad-4891-89b0-0ff5c6f7f69d with Priority: HIGHEST for action port [ 1459.980973] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.981110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.981179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.981377] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.981460] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.982259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.982368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.982990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.982990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.982990] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.982990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.982990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.982990] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.983309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.983309] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.984128] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.984128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.984128] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.984287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.984287] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cde72b4f-04ad-4891-89b0-0ff5c6f7f69d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.486279] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.487470] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.487470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.487663] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cde72b4f-04ad-4891-89b0-0ff5c6f7f69d with status ACTIVE [ 1460.487783] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.487902] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.487975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.488195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.488274] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.488451] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.488561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.488618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.488740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.488813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.489014] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.489692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.489692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.489692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.489869] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.489869] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cde72b4f-04ad-4891-89b0-0ff5c6f7f69d is going to be updated. [ 1460.513941] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.514166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.514166] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.514367] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.514503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.514665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.583244] env[66854]: INFO networking_nsxv3.common.synchronization [req-36e887ed-567c-46a5-ac08-8efbcefdc6d6 req-0b81ed45-f185-4568-a54b-e0bfff19615a tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_members [ 1460.583638] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_members [ 1460.584392] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-67896546-87c2-482e-8efd-5544fae75f04 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.584392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.584392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.584618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.584729] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.584838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.584899] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.585177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.585177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.585276] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.875732] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.875979] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.876120] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.876407] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.876646] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.876801] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.876917] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.877148] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.877293] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.877592] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1460.877707] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1460.877842] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1460.877969] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1460.878102] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1460.878210] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1460.878341] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1460.897107] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1460.897314] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1460.897430] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1460.897606] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-806" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.897976] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-4804643d-1745-4b31-ab58-0985f98ae919 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.898168] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-4804643d-1745-4b31-ab58-0985f98ae919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.898290] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-4804643d-1745-4b31-ab58-0985f98ae919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.898668] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-4804643d-1745-4b31-ab58-0985f98ae919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.898811] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4804643d-1745-4b31-ab58-0985f98ae919',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.993318] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.087322] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.087499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.087543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.088454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.088454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.088454] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.088454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.088454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.088454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.088766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.088766] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67896546-87c2-482e-8efd-5544fae75f04 already deleted. [ 1461.088766] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.401523] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.402152] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.402443] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.402872] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.403137] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.403390] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 4804643d-1745-4b31-ab58-0985f98ae919 not found, creating... [ 1461.403697] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.403883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.404019] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.404300] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.404391] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.404692] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.404889] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.404968] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.405170] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.405303] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.405476] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 4804643d-1745-4b31-ab58-0985f98ae919 is going to be created. [ 1461.428702] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.428702] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.428855] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.429161] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.429401] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.429623] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-4804643d-1745-4b31-ab58-0985f98ae919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.495574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.495797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.495797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.496025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.496126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.496237] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 is going to be created. [ 1461.543583] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.543823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.543823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.543993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.544178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.558060] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: UNINITIALIZED for 2s [ 1462.124898] env[66854]: INFO networking_nsxv3.common.synchronization [req-36e887ed-567c-46a5-ac08-8efbcefdc6d6 req-2d6a3c68-3fe5-44f0-90e2-e398ee25a430 service nova] Enqueued Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_rules [ 1462.124898] env[66854]: INFO networking_nsxv3.common.synchronization [req-36e887ed-567c-46a5-ac08-8efbcefdc6d6 req-2d6a3c68-3fe5-44f0-90e2-e398ee25a430 service nova] Enqueued Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_members [ 1462.124898] env[66854]: INFO networking_nsxv3.common.synchronization [req-36e887ed-567c-46a5-ac08-8efbcefdc6d6 req-2d6a3c68-3fe5-44f0-90e2-e398ee25a430 service nova] Enqueued Resource ID: 4804643d-1745-4b31-ab58-0985f98ae919 with Priority: HIGHEST for action port [ 1462.124898] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_rules [ 1462.125539] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_members [ 1462.125663] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4804643d-1745-4b31-ab58-0985f98ae919 with Priority: HIGHEST for action port [ 1462.125955] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67896546-87c2-482e-8efd-5544fae75f04 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.126094] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.126163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.126378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.126454] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.129092] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-67896546-87c2-482e-8efd-5544fae75f04 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.129222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.129298] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.129488] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.129642] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.129742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.129806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.129956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.130053] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.130151] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.130893] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-4804643d-1745-4b31-ab58-0985f98ae919 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.131010] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4804643d-1745-4b31-ab58-0985f98ae919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.131081] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4804643d-1745-4b31-ab58-0985f98ae919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.131232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4804643d-1745-4b31-ab58-0985f98ae919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.131318] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4804643d-1745-4b31-ab58-0985f98ae919',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.630609] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-67896546-87c2-482e-8efd-5544fae75f04 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.630609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.633342] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4804643d-1745-4b31-ab58-0985f98ae919 with status ACTIVE [ 1462.633521] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.633625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.633693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.633950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.634096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.634311] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.634395] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.634502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.634622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.634683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.634868] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.634962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.635038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.635177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.635252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.635336] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4804643d-1745-4b31-ab58-0985f98ae919 is going to be updated. [ 1462.636505] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.658153] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.658340] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.658384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.658564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.658702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.658861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4804643d-1745-4b31-ab58-0985f98ae919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.138476] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.567886] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: SUCCESS [ 1463.568177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.568343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.568683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.568879] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.569056] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.569147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.569259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.569330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.569423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.569516] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.641294] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.641457] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.641532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.641759] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.641852] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.641954] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67896546-87c2-482e-8efd-5544fae75f04 is going to be created. [ 1463.667133] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.667308] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.667352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.667547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.667705] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.677731] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67896546-87c2-482e-8efd-5544fae75f04 in Status: UNINITIALIZED for 2s [ 1464.071436] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.573690] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2bf45ff-5b2c-48be-9a63-6df0c019d7d7: rpc.has_security_group_logging(os_id): False [ 1464.591670] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.591839] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.591886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.592123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.592213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.592482] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.592588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.592652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.592807] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.592883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.592968] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 is going to be created. [ 1464.654066] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.654226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.654302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.654516] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.654699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.666194] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: IN_PROGRESS for 2s [ 1465.687737] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67896546-87c2-482e-8efd-5544fae75f04 in Status: SUCCESS [ 1465.688091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.688259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.688479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.688700] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.688842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.688915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.689090] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.689175] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.689263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.689381] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.192265] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.677501] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: SUCCESS [ 1466.677708] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.695162] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67896546-87c2-482e-8efd-5544fae75f04: rpc.has_security_group_logging(os_id): False [ 1466.711352] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.711550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.711550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.711703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.711812] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.712069] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.712173] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.712256] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.712422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.712503] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.712592] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67896546-87c2-482e-8efd-5544fae75f04 is going to be created. [ 1466.768559] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.768768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.768768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.768982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.769193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.779565] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67896546-87c2-482e-8efd-5544fae75f04 in Status: IN_PROGRESS for 2s [ 1467.127287] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.127287] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1468.793409] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67896546-87c2-482e-8efd-5544fae75f04 in Status: SUCCESS [ 1468.793792] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.128696] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.129034] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.130378] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.130749] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.131556] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.131906] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.132796] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.133206] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.134200] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.134592] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.146974] env[66854]: INFO networking_nsxv3.common.synchronization [req-d0b37c76-95fd-4b23-9a18-c61a8ef33632 req-54f8b335-cf69-4176-88d4-b1d874f36358 tempest-ServerActionsTestJSON-46106840 tempest-ServerActionsTestJSON-46106840-project-member] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1493.147570] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGHEST for action security_group_members [ 1493.147879] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.148016] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.148167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.148374] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.148530] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.148625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.148685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.148832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.148917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.149022] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.652118] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.652345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.652345] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.652459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.652555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.652752] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.652850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.652913] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.653080] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.653160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.653246] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be updated. [ 1493.680847] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.680847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.681110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.681110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.681416] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.691217] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: IN_PROGRESS for 2s [ 1495.701053] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 in Status: SUCCESS [ 1495.701429] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 deletion is rescheduled due to dependency. [ 1495.701429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.148815] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.149297] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.175089] env[66854]: INFO networking_nsxv3.common.synchronization [None req-3c8dca05-53f1-4425-9299-8dd7b6c1c533 None None] Enqueued Resource ID: f694b11a-34f7-4a84-88a5-adec1d2faf93 with Priority: HIGHEST for action port [ 1501.176189] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f694b11a-34f7-4a84-88a5-adec1d2faf93 with Priority: HIGHEST for action port [ 1501.176189] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-f694b11a-34f7-4a84-88a5-adec1d2faf93 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.176189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f694b11a-34f7-4a84-88a5-adec1d2faf93" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.176189] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f694b11a-34f7-4a84-88a5-adec1d2faf93" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.176388] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f694b11a-34f7-4a84-88a5-adec1d2faf93" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.176388] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f694b11a-34f7-4a84-88a5-adec1d2faf93',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.679318] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f694b11a-34f7-4a84-88a5-adec1d2faf93 [ 1501.679547] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.679729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.679815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.680051] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.680154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.680238] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f694b11a-34f7-4a84-88a5-adec1d2faf93 already deleted. [ 1501.680315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f694b11a-34f7-4a84-88a5-adec1d2faf93" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.777637] env[66854]: INFO networking_nsxv3.common.synchronization [None req-588edf1e-1019-4223-867b-da47d7c3aa4b tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_rules [ 1501.778159] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_rules [ 1501.778469] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.778586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.778644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.779073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.779170] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.862831] env[66854]: INFO networking_nsxv3.common.synchronization [None req-501e5684-72ec-45c3-8fab-4979e4c4e1a9 tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_rules [ 1501.863380] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_rules [ 1501.863688] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.864326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.304488] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.304848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.304848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.304926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.304983] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.305092] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 already deleted. [ 1502.305177] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.305336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.305495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.305579] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.828025] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.828206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.828306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.828500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.828585] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.828681] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 already deleted. [ 1502.828761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.261066] env[66854]: INFO networking_nsxv3.common.synchronization [None req-990791ee-e392-4574-8744-61f01cc7e987 None None] Enqueued Resource ID: 0a4383c9-2c8c-4267-89e0-9cda1644568e with Priority: HIGHEST for action port [ 1503.261066] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a4383c9-2c8c-4267-89e0-9cda1644568e with Priority: HIGHEST for action port [ 1503.261066] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a4383c9-2c8c-4267-89e0-9cda1644568e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.261066] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a4383c9-2c8c-4267-89e0-9cda1644568e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.261440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a4383c9-2c8c-4267-89e0-9cda1644568e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.261440] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a4383c9-2c8c-4267-89e0-9cda1644568e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.261506] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a4383c9-2c8c-4267-89e0-9cda1644568e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.763326] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a4383c9-2c8c-4267-89e0-9cda1644568e [ 1503.763653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.763718] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.763757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.763977] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.764086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.764186] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a4383c9-2c8c-4267-89e0-9cda1644568e already deleted. [ 1503.764269] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a4383c9-2c8c-4267-89e0-9cda1644568e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.305769] env[66854]: INFO networking_nsxv3.common.synchronization [req-40d55504-6d57-4381-b04d-0ba58ee92380 req-3c9a2cef-be34-4791-ae26-bdf826a627e5 tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1507.306322] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1507.306627] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.306750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.306825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.307307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.307519] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.307717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.307813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.308037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.308142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.308262] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.599565] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-374 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.599778] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.599907] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.600731] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.600731] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.600731] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.600913] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.601133] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.601204] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.601409] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1507.601525] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1507.601635] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1507.601747] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1507.601857] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1507.601966] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1507.602117] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1507.622611] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1507.622774] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1507.622962] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1507.623172] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.623500] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-585d0b69-df6c-4096-9b4f-b2eb83db9739 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.623670] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-585d0b69-df6c-4096-9b4f-b2eb83db9739" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.623792] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-585d0b69-df6c-4096-9b4f-b2eb83db9739" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.624224] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-585d0b69-df6c-4096-9b4f-b2eb83db9739" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.624439] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('585d0b69-df6c-4096-9b4f-b2eb83db9739',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.811406] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.811620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.811620] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.811818] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.811886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.812089] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.812187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.812252] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.812406] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.812490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.812576] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 already deleted. [ 1507.812637] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.127336] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.127623] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.127722] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.128000] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.128173] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.128328] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 585d0b69-df6c-4096-9b4f-b2eb83db9739 not found, creating... [ 1508.128593] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.128750] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.128867] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.129108] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.129454] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.129589] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.129767] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.130049] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.130317] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.130438] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.130584] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 585d0b69-df6c-4096-9b4f-b2eb83db9739 is going to be created. [ 1508.153968] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.154209] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.154326] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.154599] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.154827] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.155068] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-585d0b69-df6c-4096-9b4f-b2eb83db9739" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.850326] env[66854]: INFO networking_nsxv3.common.synchronization [req-40d55504-6d57-4381-b04d-0ba58ee92380 req-b8878d4c-a44f-44a5-94cb-6a770b687f54 service nova] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_rules [ 1508.850621] env[66854]: INFO networking_nsxv3.common.synchronization [req-40d55504-6d57-4381-b04d-0ba58ee92380 req-b8878d4c-a44f-44a5-94cb-6a770b687f54 service nova] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1508.850708] env[66854]: INFO networking_nsxv3.common.synchronization [req-40d55504-6d57-4381-b04d-0ba58ee92380 req-b8878d4c-a44f-44a5-94cb-6a770b687f54 service nova] Enqueued Resource ID: 585d0b69-df6c-4096-9b4f-b2eb83db9739 with Priority: HIGHEST for action port [ 1508.851199] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_rules [ 1508.851579] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1508.851723] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 585d0b69-df6c-4096-9b4f-b2eb83db9739 with Priority: HIGHEST for action port [ 1508.852017] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.852145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.852214] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.852413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.852497] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.853911] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.854061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.854136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.854342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.854502] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.854686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.854762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.854916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.854988] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.855105] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.856568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-585d0b69-df6c-4096-9b4f-b2eb83db9739 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.856695] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-585d0b69-df6c-4096-9b4f-b2eb83db9739" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.856756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-585d0b69-df6c-4096-9b4f-b2eb83db9739" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.857052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-585d0b69-df6c-4096-9b4f-b2eb83db9739" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.857052] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('585d0b69-df6c-4096-9b4f-b2eb83db9739',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.355257] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.355473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.356800] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.358503] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 585d0b69-df6c-4096-9b4f-b2eb83db9739 with status ACTIVE [ 1509.358735] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.358861] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.358936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.359183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.359302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.359505] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.359611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.359685] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.359872] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.360048] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.360205] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.360328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.360393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.360568] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.360648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.360752] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 585d0b69-df6c-4096-9b4f-b2eb83db9739 is going to be updated. [ 1509.384352] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.384564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.384564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.384780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.384941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.385115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-585d0b69-df6c-4096-9b4f-b2eb83db9739" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.859232] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.361713] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.362495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.362495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.362495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.362495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.362495] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 is going to be created. [ 1510.388441] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.388441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.388441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.388699] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.388775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.398722] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: UNINITIALIZED for 2s [ 1512.409882] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: SUCCESS [ 1512.410286] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.410332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.410647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.410874] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.411074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.411183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.411394] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.411492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.411580] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.411676] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.914533] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.417330] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c670e3a-6837-4f7a-80a1-1ec57250fd34: rpc.has_security_group_logging(os_id): False [ 1513.436130] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.436352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.436352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.436569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.436665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.436921] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.437033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.437101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.437268] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.437343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.437434] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 is going to be created. [ 1513.497303] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.497519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.497519] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.497664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.497847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.509384] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: IN_PROGRESS for 2s [ 1513.853247] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1513.853463] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1515.511334] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1515.511766] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:4 started [ 1515.522734] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: SUCCESS [ 1515.523013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.854984] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1518.855368] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1523.856497] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1523.857040] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1524.105680] env[66854]: INFO networking_nsxv3.common.synchronization [req-8e244ff1-d029-46ed-98a4-ebb4d72d096a req-31a0d3cf-5192-443c-bba3-94a9a48d5b50 tempest-AttachVolumeNegativeTest-1409852691 tempest-AttachVolumeNegativeTest-1409852691-project-member] Enqueued Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_members [ 1524.109114] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGHEST for action security_group_members [ 1524.109639] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-67896546-87c2-482e-8efd-5544fae75f04 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.109772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.109835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.110061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.110220] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.110320] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.110381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.110532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.110650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.110723] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.613202] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.613426] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.613472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.613731] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.613834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.614053] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.614160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.614248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.614414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.614493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.614582] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67896546-87c2-482e-8efd-5544fae75f04 is going to be updated. [ 1524.645367] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.645597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.645597] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.645776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.645923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.654797] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67896546-87c2-482e-8efd-5544fae75f04 in Status: IN_PROGRESS for 2s [ 1526.668093] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67896546-87c2-482e-8efd-5544fae75f04 in Status: SUCCESS [ 1526.668093] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67896546-87c2-482e-8efd-5544fae75f04 deletion is rescheduled due to dependency. [ 1526.668093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.109932] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1529.110342] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.459977] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.460384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.460384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.460384] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.460552] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.963357] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.466492] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.969146] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1533.969292] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1534.110782] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1534.110966] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1534.713606] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.714089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.714089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.714089] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.725343] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1534.726215] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.727256] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1534.764671] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.764671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.764671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.764916] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.779739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.780664] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1534.780771] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1534.780880] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1534.813032] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.813203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.813277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.813500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.814273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.814431] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1534.830545] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.830741] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.830872] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.831147] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.831462] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.831625] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.831744] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.831962] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.832119] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.832336] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1534.832459] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1534.832575] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1534.832720] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1534.832783] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1534.832889] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1534.833028] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1534.857346] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1534.857516] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1534.857640] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1534.857816] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-562" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.858154] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.858331] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.858456] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.858763] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.858945] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cde72b4f-04ad-4891-89b0-0ff5c6f7f69d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.895070] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.895265] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.895310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.895485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.895793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.896075] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1534.970096] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.970253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.970330] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.970536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.970795] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.971064] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:24. [ 1534.971154] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3', 'c77425c2-9b5e-4d53-92ee-45328ba247f6', '845b53d6-5efd-417e-be55-cf8d579b97a7', '145b4f21-7695-4838-8836-f19d46e237a2', '97e4bb3e-c69c-45a4-812a-564327f5ba24', '67896546-87c2-482e-8efd-5544fae75f04', 'bd8df7a7-7bdc-4ef6-8502-08f458c1982a', 'f7baf8ee-6396-451b-8325-2681f81448be', '9780d851-7ce4-4e40-ae84-ac55f3124f1e', '72bc065f-1602-44ca-b327-86db0c6cea37', 'f9e85364-8cd8-4a16-8f5e-17eb2478a9b7', 'db9d8667-c0a3-4930-8f4b-8672f1d358e9', 'c2bf45ff-5b2c-48be-9a63-6df0c019d7d7', '8c670e3a-6837-4f7a-80a1-1ec57250fd34', '28e22ce0-3477-434c-a48d-67bbaaa395f5', '404f4fa4-39e5-44f2-b930-0c5f5853142c', '99c3cde5-4f79-4bce-8884-f82cd352d6aa', 'f972a36b-9b6b-4a54-abd1-328458bb94ea', '6ab5dfec-4c69-486f-983d-2ea9413eccfa', '4147e97c-db2e-4b4d-a03e-ee42eaaab8e0', 'e609d95d-5be9-41f5-b37f-2462907e2f6a', '71d1134e-4384-4c31-836b-3726375f2c2c', 'a12683d9-3f0c-4d0e-adac-f42cb41ab395', '5b4083ca-5955-4d5e-bfa3-13977c48a75e'} {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1534.971247] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1534.990546] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.990690] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.990756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.990969] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.991075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.991168] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1534.991241] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1534.991343] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1535.153436] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.153717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.153717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.153911] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.155043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.155281] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1535.155380] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1535.155479] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1535.155479] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1535.155627] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/24 resources of Type:Security Group Rules [ 1535.155627] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGH for action security_group_rules [ 1535.155727] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGH for action security_group_rules [ 1535.155837] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGH for action security_group_rules [ 1535.155938] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGH for action security_group_rules [ 1535.155938] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 with Priority: HIGH for action security_group_rules [ 1535.156079] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGH for action security_group_rules [ 1535.156079] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a with Priority: HIGH for action security_group_rules [ 1535.156169] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGH for action security_group_rules [ 1535.156169] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e with Priority: HIGH for action security_group_rules [ 1535.156262] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGH for action security_group_rules [ 1535.156262] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGH for action security_group_rules [ 1535.156348] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGH for action security_group_rules [ 1535.156391] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGH for action security_group_rules [ 1535.156434] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGH for action security_group_rules [ 1535.156541] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 with Priority: HIGH for action security_group_rules [ 1535.156541] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGH for action security_group_rules [ 1535.156695] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGH for action security_group_rules [ 1535.156695] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f972a36b-9b6b-4a54-abd1-328458bb94ea with Priority: HIGH for action security_group_rules [ 1535.156833] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGH for action security_group_rules [ 1535.156833] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGH for action security_group_rules [ 1535.156978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.361543] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.361925] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.362176] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.362731] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.362876] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.363304] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.363560] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.363779] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.364162] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.364410] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.364871] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.365089] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.365293] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.365618] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.365806] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.366008] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: cde72b4f-04ad-4891-89b0-0ff5c6f7f69d is going to be updated. [ 1535.389716] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.389951] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.390097] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.390364] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.390568] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.390791] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.073962] env[66854]: INFO networking_nsxv3.common.synchronization [req-4bf31b13-9e9d-4d78-a1ee-e107409d5ff3 req-01a1697e-7f9b-4a79-b3df-91a37d3df052 service nova] Enqueued Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_rules [ 1536.074233] env[66854]: INFO networking_nsxv3.common.synchronization [req-4bf31b13-9e9d-4d78-a1ee-e107409d5ff3 req-01a1697e-7f9b-4a79-b3df-91a37d3df052 service nova] Enqueued Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_members [ 1536.074343] env[66854]: INFO networking_nsxv3.common.synchronization [req-4bf31b13-9e9d-4d78-a1ee-e107409d5ff3 req-01a1697e-7f9b-4a79-b3df-91a37d3df052 service nova] Enqueued Resource ID: cde72b4f-04ad-4891-89b0-0ff5c6f7f69d with Priority: HIGHEST for action port [ 1536.074812] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_rules [ 1536.074963] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_members [ 1536.075162] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cde72b4f-04ad-4891-89b0-0ff5c6f7f69d with Priority: HIGHEST for action port [ 1536.075273] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 with Priority: HIGH for action security_group_rules [ 1536.075372] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 with Priority: HIGH for action security_group_rules [ 1536.075475] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a with Priority: HIGH for action security_group_rules [ 1536.075579] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 with Priority: HIGH for action security_group_rules [ 1536.075694] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 with Priority: HIGH for action security_group_rules [ 1536.075784] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa with Priority: HIGH for action security_group_rules [ 1536.075873] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f972a36b-9b6b-4a54-abd1-328458bb94ea with Priority: HIGH for action security_group_rules [ 1536.075959] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa with Priority: HIGH for action security_group_rules [ 1536.076099] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGH for action security_group_rules [ 1536.076134] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c with Priority: HIGH for action security_group_rules [ 1536.076225] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGH for action security_group_rules [ 1536.076312] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 with Priority: HIGH for action security_group_rules [ 1536.076482] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 with Priority: HIGH for action security_group_rules [ 1536.076482] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72bc065f-1602-44ca-b327-86db0c6cea37 with Priority: HIGH for action security_group_rules [ 1536.076571] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e with Priority: HIGH for action security_group_rules [ 1536.076644] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67896546-87c2-482e-8efd-5544fae75f04 with Priority: HIGH for action security_group_rules [ 1536.077208] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7baf8ee-6396-451b-8325-2681f81448be with Priority: HIGH for action security_group_rules [ 1536.077357] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 with Priority: HIGH for action security_group_rules [ 1536.077503] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 with Priority: HIGH for action security_group_rules [ 1536.077559] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145b4f21-7695-4838-8836-f19d46e237a2 with Priority: HIGH for action security_group_rules [ 1536.077846] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.078118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.078118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.078257] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.078329] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.079366] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.079366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.079500] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.081623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.081623] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.081623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.081623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.081623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.081623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.081623] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.081623] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.081623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.081623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.081623] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.081623] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cde72b4f-04ad-4891-89b0-0ff5c6f7f69d',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.082174] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.082243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.082243] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.082756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.082756] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.083371] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-845b53d6-5efd-417e-be55-cf8d579b97a7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.083371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.083371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.083493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.083601] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('845b53d6-5efd-417e-be55-cf8d579b97a7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.084667] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd8df7a7-7bdc-4ef6-8502-08f458c1982a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.084667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.084667] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.084824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.084824] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd8df7a7-7bdc-4ef6-8502-08f458c1982a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.085499] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28e22ce0-3477-434c-a48d-67bbaaa395f5 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.085606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.085655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.085801] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.085900] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28e22ce0-3477-434c-a48d-67bbaaa395f5',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.086761] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.086897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.086951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.087111] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.087197] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4147e97c-db2e-4b4d-a03e-ee42eaaab8e0',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.088042] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.088159] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.088767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.088767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.088767] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab5dfec-4c69-486f-983d-2ea9413eccfa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.089112] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f972a36b-9b6b-4a54-abd1-328458bb94ea taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.089212] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.089275] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.089424] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.089529] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f972a36b-9b6b-4a54-abd1-328458bb94ea',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.090184] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.090292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.090366] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.090586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.090620] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c3cde5-4f79-4bce-8884-f82cd352d6aa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.091271] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.091403] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.091455] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.091607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.091682] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.092472] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-404f4fa4-39e5-44f2-b930-0c5f5853142c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.092582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.092643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.092789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.093182] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('404f4fa4-39e5-44f2-b930-0c5f5853142c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.093558] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.093652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.093840] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.093962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.094018] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.094152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.094226] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db9d8667-c0a3-4930-8f4b-8672f1d358e9',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.094910] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.095055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.095127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.095522] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.095522] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9e85364-8cd8-4a16-8f5e-17eb2478a9b7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.096413] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72bc065f-1602-44ca-b327-86db0c6cea37 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.096413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.096413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.096593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.096628] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72bc065f-1602-44ca-b327-86db0c6cea37',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.097443] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9780d851-7ce4-4e40-ae84-ac55f3124f1e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.097586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.097586] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.097741] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.097741] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9780d851-7ce4-4e40-ae84-ac55f3124f1e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.098406] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67896546-87c2-482e-8efd-5544fae75f04 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.098613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.098613] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.098715] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.098813] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67896546-87c2-482e-8efd-5544fae75f04',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.099820] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7baf8ee-6396-451b-8325-2681f81448be taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.099986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.099986] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.100167] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.100240] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7baf8ee-6396-451b-8325-2681f81448be',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.100856] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97e4bb3e-c69c-45a4-812a-564327f5ba24 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.100960] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.101046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.101191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.101263] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97e4bb3e-c69c-45a4-812a-564327f5ba24',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.101952] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c77425c2-9b5e-4d53-92ee-45328ba247f6 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.102073] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.102126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.102278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.102351] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c77425c2-9b5e-4d53-92ee-45328ba247f6',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.103560] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-145b4f21-7695-4838-8836-f19d46e237a2 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.103560] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.103732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.103732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.103796] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('145b4f21-7695-4838-8836-f19d46e237a2',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.135922] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.136120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.136183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.136371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.139541] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.139655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.161453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.161601] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3 is going to be deleted. [ 1536.162854] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.163450] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.189753] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.189914] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd8df7a7-7bdc-4ef6-8502-08f458c1982a is going to be deleted. [ 1536.232775] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.232951] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.232997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.233228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.233319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.233439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49f5308-93f6-4d6d-a4d3-5ffdac4ef7e3" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.241133] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.241133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.241133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.241133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.241133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.241133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd8df7a7-7bdc-4ef6-8502-08f458c1982a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.608661] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cde72b4f-04ad-4891-89b0-0ff5c6f7f69d with status ACTIVE [ 1536.608929] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.609124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.609222] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.609465] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.609582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.609783] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.609923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.609982] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.610158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.610266] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.610420] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.610514] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.610575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.610712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.610789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.610875] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cde72b4f-04ad-4891-89b0-0ff5c6f7f69d is going to be updated. [ 1536.611764] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.619578] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.619710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.624584] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.624726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.624726] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.624922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.625137] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.625254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.625322] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.625419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.625529] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.625624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.625712] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.677570] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.677777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.677777] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.677991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.679624] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.679755] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.680769] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.680873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.681550] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.681680] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.682410] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.682548] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.683284] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.683397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.684091] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.684202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.684862] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.684958] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.685724] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.685822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.686514] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.686611] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.687329] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.687428] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.688048] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.688545] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.688639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.689261] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.689717] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.689829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.690533] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.690950] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.691072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.691796] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.692219] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.692334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.693030] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.693468] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.693562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.694670] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.695118] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.695246] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.695335] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.695569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.695733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.695914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cde72b4f-04ad-4891-89b0-0ff5c6f7f69d" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.700862] env[66854]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.701331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.701483] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72bc065f-1602-44ca-b327-86db0c6cea37 is going to be deleted. [ 1536.702501] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.702697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.721681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.721681] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db9d8667-c0a3-4930-8f4b-8672f1d358e9 is going to be deleted. [ 1536.722549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.722750] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.755793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.755793] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4147e97c-db2e-4b4d-a03e-ee42eaaab8e0 is going to be deleted. [ 1536.756647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.757097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.797775] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.797976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.798714] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.798874] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.800769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.800919] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 845b53d6-5efd-417e-be55-cf8d579b97a7 is going to be deleted. [ 1536.801871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.802101] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.865582] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.865769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.867000] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.867130] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 404f4fa4-39e5-44f2-b930-0c5f5853142c is going to be deleted. [ 1536.868093] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.868329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.919115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.919377] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f972a36b-9b6b-4a54-abd1-328458bb94ea is going to be deleted. [ 1536.920387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.920642] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.939172] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.939451] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.956376] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.956577] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c3cde5-4f79-4bce-8884-f82cd352d6aa is going to be deleted. [ 1536.957419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.957630] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.998047] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.998326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.006397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.006646] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab5dfec-4c69-486f-983d-2ea9413eccfa is going to be deleted. [ 1537.007549] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.007799] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.076393] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.076933] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.091083] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.091339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.095425] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.095657] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67896546-87c2-482e-8efd-5544fae75f04 is going to be deleted. [ 1537.096470] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.096683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.112641] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.112879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.116172] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.120866] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.121016] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9780d851-7ce4-4e40-ae84-ac55f3124f1e is going to be deleted. [ 1537.121985] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.122278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.130627] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.160186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.160404] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7baf8ee-6396-451b-8325-2681f81448be is going to be deleted. [ 1537.161445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.161595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.215862] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.216072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.223968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.224166] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c77425c2-9b5e-4d53-92ee-45328ba247f6 is going to be deleted. [ 1537.225097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.225354] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.256141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.256317] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28e22ce0-3477-434c-a48d-67bbaaa395f5 is going to be deleted. [ 1537.257188] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.257404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.258801] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.258924] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.259982] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.260096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.278507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.278662] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 145b4f21-7695-4838-8836-f19d46e237a2 is going to be deleted. [ 1537.279564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.279771] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.316605] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.316798] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9e85364-8cd8-4a16-8f5e-17eb2478a9b7 is going to be deleted. [ 1537.317659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.317879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.350931] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.350931] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.364889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.365079] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97e4bb3e-c69c-45a4-812a-564327f5ba24 is going to be deleted. [ 1537.365979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.366213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.366309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.366438] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72bc065f-1602-44ca-b327-86db0c6cea37" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.366601] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.366765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.366847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.366964] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db9d8667-c0a3-4930-8f4b-8672f1d358e9" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.367575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.368719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.368719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.368719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4147e97c-db2e-4b4d-a03e-ee42eaaab8e0" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.368719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.368719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.368719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.368719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-845b53d6-5efd-417e-be55-cf8d579b97a7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.369075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.369075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.369075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.369179] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-404f4fa4-39e5-44f2-b930-0c5f5853142c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.369297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.369453] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.369528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.369647] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c3cde5-4f79-4bce-8884-f82cd352d6aa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.369774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.369915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.370047] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.370164] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f972a36b-9b6b-4a54-abd1-328458bb94ea" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.370289] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.370444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.370565] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.370823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab5dfec-4c69-486f-983d-2ea9413eccfa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.371015] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.371226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.371312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.371744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67896546-87c2-482e-8efd-5544fae75f04" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.371744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.371824] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.371932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.372012] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9780d851-7ce4-4e40-ae84-ac55f3124f1e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.372151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.372383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.372463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.372616] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7baf8ee-6396-451b-8325-2681f81448be" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.372794] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.372942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.373032] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.373147] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c77425c2-9b5e-4d53-92ee-45328ba247f6" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.373981] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.374140] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.374210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.374361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.374441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.374629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-145b4f21-7695-4838-8836-f19d46e237a2" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.397365] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.397546] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.397653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.398133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.398133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.398133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28e22ce0-3477-434c-a48d-67bbaaa395f5" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.506691] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.506980] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.507077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.507381] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.507506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.507703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9e85364-8cd8-4a16-8f5e-17eb2478a9b7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.539281] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.539495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.539495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.539719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.539813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.539937] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97e4bb3e-c69c-45a4-812a-564327f5ba24" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.618800] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.619071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.619071] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.619228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.619325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.619469] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 is going to be updated. [ 1537.633395] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c670e3a-6837-4f7a-80a1-1ec57250fd34: rpc.has_security_group_logging(os_id): False [ 1537.672266] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.672504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.672504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.672736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.709371] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.709617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.709617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.709788] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.709938] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.715458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.715747] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.715865] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.715934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.716150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.716228] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.716315] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 is going to be updated. [ 1537.718852] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: IN_PROGRESS for 2s [ 1537.801214] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.801483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.801483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.801717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.801871] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.818409] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: IN_PROGRESS for 2s [ 1539.729839] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: SUCCESS [ 1539.730213] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.730321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.730575] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.730800] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.730936] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.731039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.731245] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.731401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.731518] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.731680] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.833274] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: SUCCESS [ 1539.833506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.234599] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.737764] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2bf45ff-5b2c-48be-9a63-6df0c019d7d7: rpc.has_security_group_logging(os_id): False [ 1540.756071] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.756262] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.756303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.756539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.787393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.787717] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.787842] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.787909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.788131] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.788225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.788321] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 is going to be updated. [ 1540.845747] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.845747] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.846045] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.846083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.846293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.864754] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: IN_PROGRESS for 2s [ 1541.078886] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1541.079096] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1542.881881] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: SUCCESS [ 1542.882310] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.882362] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.882589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.882693] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.385253] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.385481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.385481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.385707] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.385888] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.385991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.386072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.386230] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.386316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.386412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.386573] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.889250] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.391142] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2bf45ff-5b2c-48be-9a63-6df0c019d7d7: rpc.has_security_group_logging(os_id): False [ 1544.411346] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.411625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.411625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.411880] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.411981] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.412259] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.412368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.412436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.412607] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.412714] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.412822] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 is going to be updated. [ 1544.475105] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.475319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.475319] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.475554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.475754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.491620] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: IN_PROGRESS for 2s [ 1546.079744] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.080259] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1546.508589] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: SUCCESS [ 1546.508802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.081061] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.081061] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1552.501612] env[66854]: INFO networking_nsxv3.common.synchronization [req-bd5485d7-c059-402e-aca0-1d5ea1a26097 req-4b0cb8a2-003b-4771-8aa4-a3296c62bf31 tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1552.502147] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1552.502496] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.502617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.502691] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.502922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.503095] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.503193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.503279] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.503463] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.503547] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.503644] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.785290] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-374 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.785524] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.785653] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.785918] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.786523] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.786698] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.786819] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.787152] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.787300] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.787510] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1552.787647] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1552.787751] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1552.787860] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1552.787969] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1552.788087] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1552.788217] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1552.808647] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1552.808821] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1552.808941] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1552.809133] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.809434] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-3bd68571-4c82-4c13-9c71-2fb74c07c119 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.809604] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-3bd68571-4c82-4c13-9c71-2fb74c07c119" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.809728] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-3bd68571-4c82-4c13-9c71-2fb74c07c119" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.810056] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-3bd68571-4c82-4c13-9c71-2fb74c07c119" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.810202] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bd68571-4c82-4c13-9c71-2fb74c07c119',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.006022] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.006242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.006242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.006433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.006536] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.006739] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.006837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.006901] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.007074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.007155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.007243] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 already deleted. [ 1553.007323] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.312239] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.312462] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.312596] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.312882] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.313056] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.313218] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 3bd68571-4c82-4c13-9c71-2fb74c07c119 not found, creating... [ 1553.313512] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.313675] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.313795] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.314029] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.314172] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.314455] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.314611] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.314729] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.314941] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.315092] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.315235] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 3bd68571-4c82-4c13-9c71-2fb74c07c119 is going to be created. [ 1553.336110] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.336311] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.336434] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.336689] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.336914] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.337148] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-3bd68571-4c82-4c13-9c71-2fb74c07c119" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.022792] env[66854]: INFO networking_nsxv3.common.synchronization [req-bd5485d7-c059-402e-aca0-1d5ea1a26097 req-2a0dd90c-8d1c-43b9-a9be-99b2f716875d service nova] Enqueued Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_rules [ 1554.023052] env[66854]: INFO networking_nsxv3.common.synchronization [req-bd5485d7-c059-402e-aca0-1d5ea1a26097 req-2a0dd90c-8d1c-43b9-a9be-99b2f716875d service nova] Enqueued Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1554.023159] env[66854]: INFO networking_nsxv3.common.synchronization [req-bd5485d7-c059-402e-aca0-1d5ea1a26097 req-2a0dd90c-8d1c-43b9-a9be-99b2f716875d service nova] Enqueued Resource ID: 3bd68571-4c82-4c13-9c71-2fb74c07c119 with Priority: HIGHEST for action port [ 1554.023677] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_rules [ 1554.023819] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1554.023918] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd68571-4c82-4c13-9c71-2fb74c07c119 with Priority: HIGHEST for action port [ 1554.024212] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.024336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.024439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.024666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.024746] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1554.025561] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.025684] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.025772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.025897] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.026051] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.026152] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.026220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.026348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.026433] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.026522] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1554.027220] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bd68571-4c82-4c13-9c71-2fb74c07c119 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.027321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bd68571-4c82-4c13-9c71-2fb74c07c119" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.027967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bd68571-4c82-4c13-9c71-2fb74c07c119" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.027967] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bd68571-4c82-4c13-9c71-2fb74c07c119" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.027967] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bd68571-4c82-4c13-9c71-2fb74c07c119',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1554.529725] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1554.531032] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.531186] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.531309] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bd68571-4c82-4c13-9c71-2fb74c07c119 with status ACTIVE [ 1554.531679] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.531679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.531679] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.531886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.531945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.532505] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.532505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.532505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.532505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.532505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.532829] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.532829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.532829] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.532950] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.533132] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.533174] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bd68571-4c82-4c13-9c71-2fb74c07c119 is going to be updated. [ 1554.555184] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.555411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.555411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.555581] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.555722] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.555873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bd68571-4c82-4c13-9c71-2fb74c07c119" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1555.035238] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1555.538245] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.538478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1555.538478] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1555.538682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1555.538776] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1555.538877] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 is going to be created. [ 1555.563542] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.563774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1555.563774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1555.563968] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1555.564145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1555.573127] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: UNINITIALIZED for 2s [ 1557.586293] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: SUCCESS [ 1557.586740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.586896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.587258] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.587559] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.587727] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.587825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.588085] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.588231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.588378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.588531] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1558.091488] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.091774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.091774] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.092061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.092251] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.092399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.092493] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.092635] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.092760] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.092862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.093031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.093157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.093271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.093383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.093463] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.093592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.093745] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.093835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.093835] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.093993] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.093993] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1558.596189] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2755a69e-e42f-493f-b85f-615197c1e6e8: rpc.has_security_group_logging(os_id): False [ 1558.615197] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.615409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.615409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.615573] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.615663] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.615863] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.615962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.616039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.616200] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.616278] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.616467] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.616561] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.616624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.616762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.616836] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.617046] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.617141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.617202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.617336] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.617409] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.617492] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 is going to be created. [ 1558.678944] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.679206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.679276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.679625] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.679912] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.691148] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: IN_PROGRESS for 2s [ 1559.024961] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1559.025162] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1560.703800] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: SUCCESS [ 1560.704197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.026408] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1564.026778] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1569.028083] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1569.028572] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1574.029496] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1574.029860] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1578.043417] env[66854]: INFO networking_nsxv3.common.synchronization [req-cbd2dc65-999b-42c6-a343-a99e06446ecd req-0e9f3722-3839-4c67-8943-a0f44e398c8b tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1578.044274] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1578.044274] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.044815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.044815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.044815] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.045135] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.045375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.045487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.045694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.045847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.046014] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.548718] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.548882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.548957] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.549199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.549294] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.549493] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.549595] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.549655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.549806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.549886] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.549974] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 is going to be updated. [ 1578.580547] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.580739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.580800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.582110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.582110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.589675] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: IN_PROGRESS for 2s [ 1580.600876] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: SUCCESS [ 1580.601324] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 deletion is rescheduled due to dependency. [ 1580.601324] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.076164] env[66854]: INFO networking_nsxv3.common.synchronization [None req-fdf29be2-19ce-433c-83f2-bd9aeab30ba4 tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_rules [ 1582.076712] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_rules [ 1582.077031] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.077161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.077231] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.077492] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.077576] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1582.156600] env[66854]: INFO networking_nsxv3.common.synchronization [None req-0fcab4b4-7406-4d89-826a-97f4d7e210ae tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_rules [ 1582.157204] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_rules [ 1582.157797] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.157883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.598143] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.598299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.598393] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.598606] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.598695] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.598793] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa already deleted. [ 1582.598876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.599045] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.599197] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.599277] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.119889] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.120331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.120331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.120511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.120602] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.120705] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa already deleted. [ 1583.120877] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.393494] env[66854]: INFO networking_nsxv3.common.synchronization [req-19990b1b-48f3-4764-bec0-e7caf209fab7 req-e3b599c0-75b2-4dbd-9c6a-2255bf366b4e tempest-AttachVolumeShelveTestJSON-1006044771 tempest-AttachVolumeShelveTestJSON-1006044771-project-member] Enqueued Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_members [ 1586.393947] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGHEST for action security_group_members [ 1586.394327] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.394490] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.394562] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.394763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.394945] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.395097] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.395205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.395789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.395789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.395789] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.898447] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.898673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.898673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.898845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.898939] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.899159] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.899264] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.899331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.899483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.899559] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.899645] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 is going to be updated. [ 1586.926067] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.926067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.926328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.926328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.926472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.934677] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: IN_PROGRESS for 2s [ 1587.507947] env[66854]: INFO networking_nsxv3.common.synchronization [req-ad638468-8b0e-4739-9916-b63fb043934f req-438e3393-3859-4cc3-a952-2a0500ed7a9e tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_members [ 1587.508523] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_members [ 1587.508824] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a58cc731-4f01-418c-a3c6-6cf16d83faaa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.508942] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.509022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.509277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.509438] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.509576] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.509617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.509733] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.509816] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.509910] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.794831] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock network-374 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.795041] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.795174] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.795460] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.795710] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.795866] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.795980] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.796211] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.796357] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.796587] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1587.796701] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1587.796809] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1587.796914] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1587.797043] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1587.797150] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1587.797295] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1587.830541] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1587.830800] env[66854]: DEBUG dogpile.cache.region [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1587.830879] env[66854]: DEBUG dogpile.lock [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1587.831030] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.831390] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock port-84df3492-8db4-48f9-aa82-338a9ee4a919 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.831571] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "port-84df3492-8db4-48f9-aa82-338a9ee4a919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.831692] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "port-84df3492-8db4-48f9-aa82-338a9ee4a919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.832065] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "port-84df3492-8db4-48f9-aa82-338a9ee4a919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.832239] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84df3492-8db4-48f9-aa82-338a9ee4a919',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1588.011699] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.011914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.012033] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.012390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.012505] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.012733] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.012843] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.012946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.013100] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.013180] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.013272] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa already deleted. [ 1588.013352] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.334919] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.335188] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.335323] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.335653] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.335789] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.335946] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Segment Port 84df3492-8db4-48f9-aa82-338a9ee4a919 not found, creating... [ 1588.336251] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.336417] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.336569] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.336808] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.336950] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.337263] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.337424] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.337542] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.337757] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.337889] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.338044] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Resource: SegmentPort with ID: 84df3492-8db4-48f9-aa82-338a9ee4a919 is going to be created. [ 1588.358605] env[66854]: DEBUG networking_nsxv3.common.locking [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.358865] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.358948] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.359259] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.359502] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.359729] env[66854]: DEBUG oslo_concurrency.lockutils [None req-de6b7e0d-90cd-42db-bbc8-fd36913dbc9f None None] Releasing lock "port-84df3492-8db4-48f9-aa82-338a9ee4a919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.944769] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 in Status: SUCCESS [ 1588.945387] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 deletion is rescheduled due to dependency. [ 1588.945651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.066385] env[66854]: INFO networking_nsxv3.common.synchronization [req-ad638468-8b0e-4739-9916-b63fb043934f req-6e15cc31-8b02-43f0-9262-b6df01cb32b4 service nova] Enqueued Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_rules [ 1589.066538] env[66854]: INFO networking_nsxv3.common.synchronization [req-ad638468-8b0e-4739-9916-b63fb043934f req-6e15cc31-8b02-43f0-9262-b6df01cb32b4 service nova] Enqueued Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_members [ 1589.066715] env[66854]: INFO networking_nsxv3.common.synchronization [req-ad638468-8b0e-4739-9916-b63fb043934f req-6e15cc31-8b02-43f0-9262-b6df01cb32b4 service nova] Enqueued Resource ID: 84df3492-8db4-48f9-aa82-338a9ee4a919 with Priority: HIGHEST for action port [ 1589.066901] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_rules [ 1589.067047] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_members [ 1589.067146] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84df3492-8db4-48f9-aa82-338a9ee4a919 with Priority: HIGHEST for action port [ 1589.067673] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.067840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.067879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.068059] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.068282] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.070162] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a58cc731-4f01-418c-a3c6-6cf16d83faaa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.070162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.070162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.070162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.070162] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.070162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.070162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.070162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.070162] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.070162] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.070989] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-84df3492-8db4-48f9-aa82-338a9ee4a919 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.070989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84df3492-8db4-48f9-aa82-338a9ee4a919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.070989] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84df3492-8db4-48f9-aa82-338a9ee4a919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.071181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84df3492-8db4-48f9-aa82-338a9ee4a919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.071222] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84df3492-8db4-48f9-aa82-338a9ee4a919',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.573256] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.574621] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a58cc731-4f01-418c-a3c6-6cf16d83faaa taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.574769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.574901] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84df3492-8db4-48f9-aa82-338a9ee4a919 with status ACTIVE [ 1589.575041] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.575150] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.575220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.575461] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.575555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.575732] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.575830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.575893] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.576062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.576142] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.576372] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.576423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.576458] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.576603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.576673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.576755] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84df3492-8db4-48f9-aa82-338a9ee4a919 is going to be updated. [ 1589.598605] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.598796] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.598837] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.599014] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.599154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.599309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84df3492-8db4-48f9-aa82-338a9ee4a919" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.078813] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.582055] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.582055] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.582357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.582357] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.582472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.582562] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa is going to be created. [ 1590.604906] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.605077] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.605158] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.605360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.605845] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.615342] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa in Status: UNINITIALIZED for 2s [ 1592.626761] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa in Status: SUCCESS [ 1592.627178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.627178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.627305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.627501] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.627608] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.627681] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.627828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.627909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.627996] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.628104] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.130509] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.633155] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a58cc731-4f01-418c-a3c6-6cf16d83faaa: rpc.has_security_group_logging(os_id): False [ 1593.653484] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.653659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.653659] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.653855] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.653945] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.654202] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.654305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.654371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.654570] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.654645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.654736] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa is going to be created. [ 1593.719229] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.719486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.719486] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.719650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.719832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.730690] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa in Status: IN_PROGRESS for 2s [ 1594.068264] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1594.068485] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1595.742797] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa in Status: SUCCESS [ 1595.743235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.070023] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1599.070375] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1604.071243] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1604.071649] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1609.072240] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1609.072632] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1614.073327] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1614.073827] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1619.074802] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1619.075235] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1624.076345] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1624.076345] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1629.078022] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1629.078555] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1634.079591] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1634.080080] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1639.081356] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1639.081807] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1644.083139] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1644.083580] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1649.084124] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1649.084728] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1654.085673] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1654.085673] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1659.087358] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1659.087744] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1664.089117] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1664.089812] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1669.090789] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1669.091209] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1674.092360] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1674.092735] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1679.093473] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1679.093994] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1684.095118] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1684.095518] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1689.096949] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1689.097444] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1694.098759] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1694.098759] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1699.099776] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1699.100265] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1699.646300] env[66854]: INFO networking_nsxv3.common.synchronization [req-b3414052-dadb-457d-b20d-416ca5a10de2 req-189935a3-267d-4b33-a17d-7390ca658497 tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_members [ 1699.647025] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGHEST for action security_group_members [ 1699.647145] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-a58cc731-4f01-418c-a3c6-6cf16d83faaa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.647270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.647329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.647527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.647827] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1699.647827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1699.647827] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1699.647978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1699.648112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.648168] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1700.150988] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.151436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.151436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.151543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.151543] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.151743] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.151860] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.151954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.152112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.152192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.152283] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa is going to be updated. [ 1700.189341] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1700.189556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1700.189556] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1700.189670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1700.189820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1700.198698] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa in Status: IN_PROGRESS for 2s [ 1702.209913] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa in Status: SUCCESS [ 1702.210311] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa deletion is rescheduled due to dependency. [ 1702.210311] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1704.647781] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1704.648099] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1709.162724] env[66854]: INFO networking_nsxv3.common.synchronization [req-eac7c186-f80f-4373-94f3-482738a651a0 req-4bd39fd3-fef8-4857-951b-bda591bc8619 tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1709.163322] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1709.163644] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.163768] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.163841] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.164043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.164205] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.164309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.164371] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.164527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.164612] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.164706] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1709.450697] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-374 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.450904] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.451037] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.451305] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.451646] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.451806] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.451883] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.452115] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.452271] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.452488] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1709.452613] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1709.452723] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1709.452829] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1709.452938] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1709.453053] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1709.453238] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1709.476782] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1709.477012] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1709.477114] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1709.477283] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.477609] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-e36a9436-baf7-4284-b059-b766b75fa2db taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.477768] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.477875] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.478228] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.478366] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e36a9436-baf7-4284-b059-b766b75fa2db',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1709.666508] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.666737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.666737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.666921] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.667027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.667232] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.667337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.667401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.667582] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.667692] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.667744] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 is going to be updated. [ 1709.692174] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.692397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.692397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.692617] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.692764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.701138] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: IN_PROGRESS for 2s [ 1709.981145] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.981380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.981561] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.981843] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.981995] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.982166] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port e36a9436-baf7-4284-b059-b766b75fa2db not found, creating... [ 1709.982432] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.982609] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.982745] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.982970] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.983124] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.983413] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1709.983572] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1709.983690] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1709.983923] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1709.984078] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1709.984223] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: e36a9436-baf7-4284-b059-b766b75fa2db is going to be created. [ 1710.003399] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.003566] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.003689] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.003931] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.004169] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.004387] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1710.699978] env[66854]: INFO networking_nsxv3.common.synchronization [req-eac7c186-f80f-4373-94f3-482738a651a0 req-40648dba-45d6-49e0-a293-0dae541d93e2 service nova] Enqueued Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_rules [ 1710.700675] env[66854]: INFO networking_nsxv3.common.synchronization [req-eac7c186-f80f-4373-94f3-482738a651a0 req-40648dba-45d6-49e0-a293-0dae541d93e2 service nova] Enqueued Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1710.700675] env[66854]: INFO networking_nsxv3.common.synchronization [req-eac7c186-f80f-4373-94f3-482738a651a0 req-40648dba-45d6-49e0-a293-0dae541d93e2 service nova] Enqueued Resource ID: e36a9436-baf7-4284-b059-b766b75fa2db with Priority: HIGHEST for action port [ 1710.700874] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_rules [ 1710.700874] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1710.700981] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e36a9436-baf7-4284-b059-b766b75fa2db with Priority: HIGHEST for action port [ 1710.701395] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.701554] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.701609] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.701810] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.701891] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1710.703181] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.703392] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.703646] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e36a9436-baf7-4284-b059-b766b75fa2db taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1710.703756] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1710.703825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1710.703994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1710.704084] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e36a9436-baf7-4284-b059-b766b75fa2db',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1711.204654] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.204654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.206047] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e36a9436-baf7-4284-b059-b766b75fa2db with status ACTIVE [ 1711.206175] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.206301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.206413] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.206652] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.206703] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.206915] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.207046] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.207141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.207313] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.207420] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.207640] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.207751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.207831] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.207991] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.208108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.208203] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e36a9436-baf7-4284-b059-b766b75fa2db is going to be updated. [ 1711.230857] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.231087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.231163] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.231348] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.231507] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.231712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.710319] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: SUCCESS [ 1711.710729] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 deletion is rescheduled due to dependency. [ 1711.710729] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.710805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.710955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.711159] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1711.711273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1711.711342] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1711.711504] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1711.711618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1711.711718] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1712.214357] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1712.717350] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1713.221113] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.221380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.221473] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.221803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.221803] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.221883] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 is going to be updated. [ 1713.248802] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1713.248994] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1713.249060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1713.249244] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1713.249412] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1713.259361] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: IN_PROGRESS for 2s [ 1715.270479] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: SUCCESS [ 1715.270820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.270820] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.270999] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.271215] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.271337] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.271423] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.271589] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.271671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.271762] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.271884] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1715.702465] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1715.702653] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1715.774369] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.774603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.774603] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.774832] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.774989] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.775114] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.775156] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.775297] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.775380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.775489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.775620] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.775725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.775764] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.775904] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.776058] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1715.776143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1715.776235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1715.776339] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1715.776415] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.776526] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1715.776588] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1716.279506] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2755a69e-e42f-493f-b85f-615197c1e6e8: rpc.has_security_group_logging(os_id): False [ 1716.298216] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.298445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.298445] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.298649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.298742] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.298939] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.299064] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.299144] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.299275] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.299351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.299541] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.299638] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.299702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.299879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.299979] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.300201] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.300293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.300351] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.300495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.300569] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.300656] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 is going to be updated. [ 1716.360653] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1716.360879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1716.360879] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1716.361058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1716.361183] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1716.373518] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: IN_PROGRESS for 2s [ 1717.973313] env[66854]: INFO networking_nsxv3.common.synchronization [req-1e557502-26c2-42f1-8fee-17c2ae82d86f req-31c9dbec-dd5e-4fe1-b697-e9d6ab2634e0 tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1717.973863] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGHEST for action security_group_members [ 1717.974200] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.974326] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.974390] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.974593] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.974746] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1717.974840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1717.974903] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1717.975058] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1717.975145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1717.975239] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1718.435809] env[66854]: INFO networking_nsxv3.common.synchronization [req-1e557502-26c2-42f1-8fee-17c2ae82d86f req-31c9dbec-dd5e-4fe1-b697-e9d6ab2634e0 tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: e36a9436-baf7-4284-b059-b766b75fa2db with Priority: HIGHEST for action port [ 1718.436497] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e36a9436-baf7-4284-b059-b766b75fa2db with Priority: HIGHEST for action port [ 1718.436944] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-e36a9436-baf7-4284-b059-b766b75fa2db taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.437126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.437241] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.437419] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.437506] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e36a9436-baf7-4284-b059-b766b75fa2db',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1718.477973] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.478270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.478396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.478666] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.478779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.479061] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.479210] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.479292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.479528] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.479618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.479755] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 is going to be updated. [ 1718.490180] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: SUCCESS [ 1718.490454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.517623] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.517828] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.517909] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.518155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.518304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.528287] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: IN_PROGRESS for 2s [ 1718.939382] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e36a9436-baf7-4284-b059-b766b75fa2db with status ACTIVE [ 1718.940112] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.940112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.940112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.940112] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.940338] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.940338] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.940483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.940542] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.940640] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.940713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.941127] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.941127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.941127] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.941299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.941299] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.941503] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e36a9436-baf7-4284-b059-b766b75fa2db is going to be updated. [ 1718.975547] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1718.975883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1718.975883] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1718.976151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1718.976276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1718.976434] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e36a9436-baf7-4284-b059-b766b75fa2db" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.538541] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 in Status: SUCCESS [ 1720.538923] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 deletion is rescheduled due to dependency. [ 1720.538923] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1723.438156] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1723.438609] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1728.439824] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1728.439824] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1733.440691] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1733.441129] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1738.442076] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1738.442831] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1742.725065] env[66854]: INFO networking_nsxv3.common.synchronization [req-13b96c48-5fe0-4d54-ba95-6dec8653070f req-1532b7ad-84e7-4eec-87a4-ffb5c558fd9d tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1742.725416] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1742.725780] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.725928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.726020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.726378] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.726557] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.726687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.726780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.726976] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.727118] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.727230] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1742.979358] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock network-374 taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.979560] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.979686] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.979975] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.980250] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.980414] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.980531] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.980749] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.980894] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.981266] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1742.981391] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] NeedRegenerationException {{(pid=66854) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1742.981509] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] no value, waiting for create lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1742.981605] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] value creation lock acquired {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1742.981719] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] No value present for key: 'zone-id' {{(pid=66854) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1742.981826] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Calling creation function for not-yet-present value {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1742.981958] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1743.002357] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1743.002536] env[66854]: DEBUG dogpile.cache.region [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66854) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1743.002663] env[66854]: DEBUG dogpile.lock [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Released creation lock {{(pid=66854) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1743.002828] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "network-374" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.003145] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock port-034d0f2a-b35c-4263-bbb5-01e8a2969cac taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.003317] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "port-034d0f2a-b35c-4263-bbb5-01e8a2969cac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.003434] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "port-034d0f2a-b35c-4263-bbb5-01e8a2969cac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.003794] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "port-034d0f2a-b35c-4263-bbb5-01e8a2969cac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.003938] env[66854]: DEBUG networking_nsxv3.api.rpc [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('034d0f2a-b35c-4263-bbb5-01e8a2969cac',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1743.229525] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1743.505958] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.506219] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.506349] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.506634] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.506788] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.506968] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Segment Port 034d0f2a-b35c-4263-bbb5-01e8a2969cac not found, creating... [ 1743.507223] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.507380] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.507499] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.507717] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.508139] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.508139] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.508304] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.508416] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.508619] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.508754] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.508889] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Resource: SegmentPort with ID: 034d0f2a-b35c-4263-bbb5-01e8a2969cac is going to be created. [ 1743.528702] env[66854]: DEBUG networking_nsxv3.common.locking [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.528938] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.529079] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.529354] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.529593] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.529826] env[66854]: DEBUG oslo_concurrency.lockutils [None req-b8cee398-26a6-40e2-9783-b0f1185ef007 None None] Releasing lock "port-034d0f2a-b35c-4263-bbb5-01e8a2969cac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.731919] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.211446] env[66854]: INFO networking_nsxv3.common.synchronization [req-13b96c48-5fe0-4d54-ba95-6dec8653070f req-78dc8851-0a06-4ab3-88b9-200e8716db29 service nova] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_rules [ 1744.211446] env[66854]: INFO networking_nsxv3.common.synchronization [req-13b96c48-5fe0-4d54-ba95-6dec8653070f req-78dc8851-0a06-4ab3-88b9-200e8716db29 service nova] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1744.211446] env[66854]: INFO networking_nsxv3.common.synchronization [req-13b96c48-5fe0-4d54-ba95-6dec8653070f req-78dc8851-0a06-4ab3-88b9-200e8716db29 service nova] Enqueued Resource ID: 034d0f2a-b35c-4263-bbb5-01e8a2969cac with Priority: HIGHEST for action port [ 1744.211446] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_rules [ 1744.211446] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1744.211446] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 034d0f2a-b35c-4263-bbb5-01e8a2969cac with Priority: HIGHEST for action port [ 1744.211446] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.211446] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.211956] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.212293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.212614] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.214229] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.214732] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.217071] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock port-034d0f2a-b35c-4263-bbb5-01e8a2969cac taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.217341] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-034d0f2a-b35c-4263-bbb5-01e8a2969cac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.217514] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-034d0f2a-b35c-4263-bbb5-01e8a2969cac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.217789] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-034d0f2a-b35c-4263-bbb5-01e8a2969cac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.217963] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('034d0f2a-b35c-4263-bbb5-01e8a2969cac',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.235072] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.235072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.235072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.235400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.235400] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.235400] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 is going to be updated. [ 1744.264541] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.264780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.264780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.264889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.265027] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.273499] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: IN_PROGRESS for 2s [ 1744.715540] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.715770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.720118] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 034d0f2a-b35c-4263-bbb5-01e8a2969cac with status ACTIVE [ 1744.720348] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.720481] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.720550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.720761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.720850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.721050] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.721153] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.721211] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.721361] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.721435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.721635] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.721739] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.721800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.721941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.722025] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.722112] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 034d0f2a-b35c-4263-bbb5-01e8a2969cac is going to be updated. [ 1744.742634] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.743108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.743108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.743108] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.743248] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.743360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-034d0f2a-b35c-4263-bbb5-01e8a2969cac" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.283609] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: IN_PROGRESS for 4s [ 1748.296067] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: SUCCESS [ 1748.296067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1748.296067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1748.296067] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1748.296067] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1748.296658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1748.296658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1748.296658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1748.296658] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1748.296658] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1748.798790] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1749.211405] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1749.211636] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1749.301175] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1749.803411] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.803694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.803694] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.803838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.803928] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.804098] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 is going to be updated. [ 1749.835416] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.835615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.835615] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.835850] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.835992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.844723] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: IN_PROGRESS for 2s [ 1751.857199] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: SUCCESS [ 1751.857622] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1751.857670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1751.857949] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1751.858379] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1751.858379] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1751.858596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1751.858596] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1751.858665] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1751.858737] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1751.858862] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1752.361114] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1752.865104] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c670e3a-6837-4f7a-80a1-1ec57250fd34: rpc.has_security_group_logging(os_id): False [ 1752.885724] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.886028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.886028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.886193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.886272] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.886624] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.886786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.886786] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.887052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.887052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.887190] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 is going to be updated. [ 1752.962515] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1752.962515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1752.962515] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1752.962725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1752.962873] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1752.981814] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: IN_PROGRESS for 2s [ 1754.212868] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1754.213222] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1754.999207] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: SUCCESS [ 1754.999422] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.512397] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:4 completed [ 1755.512796] env[66854]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-409d321d-f3dc-4ee9-be28-1c62ce18c79b None None] NSXv3 Agent Agent loop - iteration:5 started [ 1759.214176] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1759.214725] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1764.215235] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1764.215631] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1769.215960] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1769.216392] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1772.458487] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1772.459069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1772.459069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1772.459069] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1772.459277] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1772.962264] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1773.464323] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1773.966286] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1773.966456] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1774.217286] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1774.217679] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1774.757440] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.757931] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.757931] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.757931] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.770450] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1774.771253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.771986] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1774.812953] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.813195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.813195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.813401] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.826539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.827412] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1774.827499] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1774.827593] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1774.850877] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.851082] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.851138] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.851305] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.851674] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.851817] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1774.931654] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.931895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.931895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.932075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.932398] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.932678] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1775.005450] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.005725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.005725] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.006161] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.006232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.006520] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:8. [ 1775.006606] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c2bf45ff-5b2c-48be-9a63-6df0c019d7d7', '8c670e3a-6837-4f7a-80a1-1ec57250fd34', 'e609d95d-5be9-41f5-b37f-2462907e2f6a', 'a58cc731-4f01-418c-a3c6-6cf16d83faaa', '71d1134e-4384-4c31-836b-3726375f2c2c', '2755a69e-e42f-493f-b85f-615197c1e6e8', 'a12683d9-3f0c-4d0e-adac-f42cb41ab395', '5b4083ca-5955-4d5e-bfa3-13977c48a75e'} {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1775.006701] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1775.024682] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.024870] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.024926] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.025115] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.025198] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.025309] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1775.025380] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1775.025483] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1775.094819] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.095086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.095086] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.095239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.096386] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.096630] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1775.096709] env[66854]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66854) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1775.096769] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1775.096838] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1775.096909] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 8/8 resources of Type:Security Group Rules [ 1775.096988] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGH for action security_group_rules [ 1775.097066] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGH for action security_group_rules [ 1775.097135] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGH for action security_group_rules [ 1775.097250] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGH for action security_group_rules [ 1775.097250] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 71d1134e-4384-4c31-836b-3726375f2c2c with Priority: HIGH for action security_group_rules [ 1775.097355] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGH for action security_group_rules [ 1775.097390] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGH for action security_group_rules [ 1775.097421] env[66854]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGH for action security_group_rules [ 1775.097484] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1775.097534] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1775.097721] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.097833] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.097887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.098039] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.098123] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.098298] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.098387] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.098442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.098577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.098649] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.098813] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.098905] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.098955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.099303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.099303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.099368] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.099435] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.099472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.099579] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.099645] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.099810] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.099898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.099954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.100087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.100160] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.100324] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.100410] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.100459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.100587] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.100653] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.100809] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.100889] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.100948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.101087] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.101154] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.101328] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.101476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.101476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.101682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.101682] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.101848] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.101922] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.101954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.102124] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.102191] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.102360] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.102444] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.102506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.102628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.102697] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.102861] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.102946] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.103008] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.103145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.103216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.103413] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.103511] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.103555] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.103688] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.103754] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.103917] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.104009] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.104072] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.104205] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.104281] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.104484] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.104574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.104629] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.104761] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.104834] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.104999] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.105096] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.105145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.105276] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.105346] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.105507] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.105591] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.105644] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.105793] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.105862] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.106035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.106120] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.106173] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.106304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.106372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.106535] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.106624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.106673] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.106805] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.106881] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.107057] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.107145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.107199] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.107329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.107397] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.107558] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.107643] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.107702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.107826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.107896] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.108070] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.108182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.108253] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.108332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.108402] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.108564] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.108704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.108704] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.108823] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.108894] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.109062] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.109151] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.109206] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.109334] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.109396] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.109560] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.109648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.109698] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.109821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.109891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.110066] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.110149] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.110202] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.110329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.110399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.110560] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.110717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.110717] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.110825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.110878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.111050] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.111145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.111193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.111316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.111385] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.111547] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.111628] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.111683] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.111814] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.111895] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.112050] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.112143] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.112192] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.112312] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.112380] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.112542] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.112624] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.112686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.112806] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.112876] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.113049] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.113155] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.113227] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.113315] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.113383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.113544] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.113650] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.113713] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.113838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.113910] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.114092] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.114176] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.114232] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.114360] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.114429] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.114591] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.114676] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.114736] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.114858] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.114930] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.115103] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.115187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.115242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.115370] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.115439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.115601] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.115693] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.115763] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.115891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.115962] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.116139] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.116225] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.116280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.116407] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.116476] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.116636] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.116744] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.116813] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.116941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.117020] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.117185] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.117271] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.117332] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.117452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.117523] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.117685] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.117765] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.117822] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.117948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.118028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.118191] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.118280] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.118335] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.118459] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.118527] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.118687] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.118772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.118830] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.118955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.119037] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.119200] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.119303] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.119353] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.119462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.119531] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.119694] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.119779] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.119825] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.119955] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.120035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.120200] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.120287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.120343] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.120467] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.120530] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.120693] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.120780] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.120900] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.120953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.121028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.121192] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.121273] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.121328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.121452] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.121521] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.121681] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.121767] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.121821] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.121948] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.122040] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.122196] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.122321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.122321] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.122454] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.122502] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.122666] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.122751] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.122800] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.122925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.122997] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.123172] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.123259] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.123316] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.123441] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.123506] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.123699] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.123791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.123848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.123978] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.124062] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.124838] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.124953] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.125034] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.125203] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.125282] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.125463] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.125552] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.125655] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.125775] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.125855] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.126042] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.126137] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.126193] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.126331] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.126405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.126574] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.126668] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.126740] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.126882] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.126954] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.127136] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.127226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.127282] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.127414] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.127485] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.127650] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.127738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.127802] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.127932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.128208] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.128208] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.128293] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.128325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.128436] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.128498] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.128666] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.128757] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.128808] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.128940] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.129013] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.129186] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.129292] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.129349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.129479] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.129532] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.129662] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.129934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.129934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.129934] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.130181] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.130181] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.130375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.130375] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.130487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.130487] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.130720] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.130720] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.130840] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.130887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.131024] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.131102] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.131182] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.131368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.131368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.131464] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.131566] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.131651] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.131719] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.131847] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.131917] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.132092] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.132178] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.132302] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.132355] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.132417] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.132580] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.132664] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.132712] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.132844] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.132914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.133094] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.133172] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.133221] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.133399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.133399] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.133568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.133686] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.133721] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.133826] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.133891] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.134069] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.134157] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.134207] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.134335] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.134404] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.134568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.134654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.134710] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.134838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.134908] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.135084] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.135194] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.135226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.135349] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.135418] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.135539] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1775.135596] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1775.135665] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1775.207246] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.207468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.207468] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.207648] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.207975] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.208269] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1775.283057] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.283284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.283284] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.283474] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.283838] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.296918] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.218623] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1779.219085] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=8], Jobs=0 [ 1779.219085] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 with Priority: HIGH for action security_group_rules [ 1779.219085] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e609d95d-5be9-41f5-b37f-2462907e2f6a with Priority: HIGH for action security_group_rules [ 1779.219085] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 with Priority: HIGH for action security_group_rules [ 1779.219303] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 with Priority: HIGH for action security_group_rules [ 1779.219303] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e with Priority: HIGH for action security_group_rules [ 1779.219401] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d1134e-4384-4c31-836b-3726375f2c2c with Priority: HIGH for action security_group_rules [ 1779.219457] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGH for action security_group_rules [ 1779.219560] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa with Priority: HIGH for action security_group_rules [ 1779.219937] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.220075] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.220145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.220364] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.220452] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2bf45ff-5b2c-48be-9a63-6df0c019d7d7',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.221898] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e609d95d-5be9-41f5-b37f-2462907e2f6a taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.221898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.221898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.221898] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.222207] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e609d95d-5be9-41f5-b37f-2462907e2f6a',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.223035] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.223035] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.223216] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.223306] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.223388] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a12683d9-3f0c-4d0e-adac-f42cb41ab395',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.224392] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2755a69e-e42f-493f-b85f-615197c1e6e8 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.224489] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.224537] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.225235] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.225235] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2755a69e-e42f-493f-b85f-615197c1e6e8',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.225588] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.225588] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.225687] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.225797] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.225867] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b4083ca-5955-4d5e-bfa3-13977c48a75e',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.226568] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71d1134e-4384-4c31-836b-3726375f2c2c taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.226671] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.226738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.226887] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.226994] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71d1134e-4384-4c31-836b-3726375f2c2c',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.227782] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.227915] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.227952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.228226] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.228226] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.228966] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.229061] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.229130] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.229287] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.229361] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a58cc731-4f01-418c-a3c6-6cf16d83faaa',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.733012] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.733220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.733220] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.733541] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.733794] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.733941] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.734038] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.734242] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.734358] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.734456] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.734600] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.774856] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.775041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.775091] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.775307] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.777184] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.777372] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.778224] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.778329] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.779230] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.779368] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.780131] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.780238] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.780919] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.781026] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.782032] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.782136] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.800938] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.801105] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e609d95d-5be9-41f5-b37f-2462907e2f6a is going to be deleted. [ 1779.802028] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.802239] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.822475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.822657] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2755a69e-e42f-493f-b85f-615197c1e6e8 is going to be deleted. [ 1779.823572] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.823791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.842079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.842238] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a58cc731-4f01-418c-a3c6-6cf16d83faaa is going to be deleted. [ 1779.843052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.843270] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.864065] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.864304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.870987] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.871159] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2bf45ff-5b2c-48be-9a63-6df0c019d7d7 is going to be deleted. [ 1779.872074] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.872304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.879400] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.879577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.890411] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.890558] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b4083ca-5955-4d5e-bfa3-13977c48a75e is going to be deleted. [ 1779.891499] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.891716] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.915550] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.915728] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71d1134e-4384-4c31-836b-3726375f2c2c is going to be deleted. [ 1779.916769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.916992] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.931311] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.931577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.938240] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.938418] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a12683d9-3f0c-4d0e-adac-f42cb41ab395 is going to be deleted. [ 1779.939347] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.939564] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.939654] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.939770] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e609d95d-5be9-41f5-b37f-2462907e2f6a" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.939925] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.940102] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.940187] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.940301] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2755a69e-e42f-493f-b85f-615197c1e6e8" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.940846] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.941052] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.941141] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.941260] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a58cc731-4f01-418c-a3c6-6cf16d83faaa" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.012211] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.012431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1780.012431] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1780.012614] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1780.012702] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.012817] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b4083ca-5955-4d5e-bfa3-13977c48a75e" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.013589] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.013701] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1780.013769] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1780.013952] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1780.014079] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.014145] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2bf45ff-5b2c-48be-9a63-6df0c019d7d7" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.056456] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.056728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1780.056728] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1780.056907] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1780.057060] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.057254] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a12683d9-3f0c-4d0e-adac-f42cb41ab395" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.062092] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.062295] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1780.062295] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1780.062480] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1780.062558] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.062670] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71d1134e-4384-4c31-836b-3726375f2c2c" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.243441] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1780.746150] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c670e3a-6837-4f7a-80a1-1ec57250fd34: rpc.has_security_group_logging(os_id): False [ 1780.765192] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.765439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1780.765439] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1780.765618] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1780.784275] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.784615] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.784738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1780.784809] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1780.785022] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1780.785110] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.785204] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 is going to be updated. [ 1780.844062] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.844309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1780.844309] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1780.844577] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1780.844734] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.860925] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: IN_PROGRESS for 2s [ 1782.875568] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: SUCCESS [ 1782.876043] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.220660] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1784.220660] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1789.221464] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1789.221948] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1794.222609] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1794.223054] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1799.224430] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1799.224881] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1804.225845] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1804.226298] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1809.227693] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1809.228182] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1809.898954] env[66854]: INFO networking_nsxv3.common.synchronization [req-610f0169-8cd0-4dba-9a7e-2612537c6af7 req-491b7152-7ab0-4f41-bcdf-596f7ffc52bb tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1809.899566] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1809.899887] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1809.900495] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1809.900592] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1809.900772] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1809.900933] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1809.901049] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1809.901133] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1809.901325] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1809.901462] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1809.901519] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1810.404994] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1810.907953] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1811.411064] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.411475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.411475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.411475] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.411574] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.411707] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 is going to be updated. [ 1811.492310] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1811.492639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1811.492639] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1811.492791] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1811.493328] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1811.508548] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: IN_PROGRESS for 2s [ 1813.520965] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: SUCCESS [ 1813.521383] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1814.901245] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1814.901622] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1819.902544] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1819.902966] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1824.903742] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1824.904181] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1825.258857] env[66854]: INFO networking_nsxv3.common.synchronization [req-457be9cc-e774-4416-aa90-72daa0bb97cc req-d77e51df-e12b-4ba5-8b9c-71b6c9a7fd08 tempest-ServerActionsTestOtherA-1621294994 tempest-ServerActionsTestOtherA-1621294994-project-member] Enqueued Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1825.258918] env[66854]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 with Priority: HIGHEST for action security_group_members [ 1825.259283] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c670e3a-6837-4f7a-80a1-1ec57250fd34 taken with stack trace [, , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1825.259405] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1825.259472] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1825.259738] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1825.259837] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1825.259932] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1825.260041] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1825.260195] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1825.260304] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1825.261018] env[66854]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c670e3a-6837-4f7a-80a1-1ec57250fd34',) {} {{(pid=66854) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1825.762957] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1825.763263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1825.763263] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1825.763442] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1825.763539] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1825.763746] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1825.763848] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1825.763914] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1825.764083] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1825.764169] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1825.764258] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 is going to be updated. [ 1825.803644] env[66854]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66854) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1825.803878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1825.803878] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1825.804126] env[66854]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1825.804277] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1825.813434] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: IN_PROGRESS for 2s [ 1827.828103] env[66854]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 in Status: SUCCESS [ 1827.828483] env[66854]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c670e3a-6837-4f7a-80a1-1ec57250fd34 deletion is rescheduled due to dependency. [ 1827.828483] env[66854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c670e3a-6837-4f7a-80a1-1ec57250fd34" {{(pid=66854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1830.260248] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1830.260648] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1835.261294] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1835.261685] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1840.262690] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1840.262914] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1845.264027] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1845.264398] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1850.265027] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1850.265484] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1855.266067] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1855.266460] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1860.267396] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1860.267396] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1865.268366] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1865.268742] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1870.269387] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1870.269783] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1875.270878] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1875.271294] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1880.272382] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1880.272920] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1885.273541] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1885.273833] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1890.275214] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1890.275663] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1895.276012] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1895.276324] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1900.277689] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1900.278156] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1905.278486] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1905.278971] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1910.279964] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1910.280449] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1915.280710] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1915.281161] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1920.282103] env[66854]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1920.282834] env[66854]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0